TECHNIQUES  FOR  EVALUATING  OPERATOR 
LOADING  IN  MANLMACHINE  SYSTEMS 


A  "Model”  for  Di^'itnl  Simiilntion  of 
One  nnd  T\vO'C')per:itor  Man-Machine  Systems 


*r' 


0^  '  .. 


I'tt'i'iiuti  !•<>' 

I'tminfcrinu  Branch 

OIMt  I  or  NA\'A1.  Hi  ShAHCH 

/  nth'  (unn.iit 


Reproduced  From 
Best  Available  Copy 


H  ,i\  f  t . 


/  V«»»«  \  /f.juti. 


NOTICE:  When  government  or  other  drawings,  speci¬ 
fications  or  other  data  are  used  for  any  purpose 
other  than  in  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S. 
Government  thereby  Incvirs  no  responsibility,  nor  any 
obligation  \rtiat soever;  and  the  fact  that  the  Govern¬ 
ment  may  have  fonnulated,  furnished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regarded  by  implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  any  rights 
or  permission  to  manufactvire,  use  or  sell  euiy 
patented  invention  that  may  in  any  way  be  related 
thereto. 


TECHNIQUES 

LOADING 


FOR  EVALUATING  OPERATOR 
IN  MAN-MACHINE  SYSTEMS 


A  "Model"  for  Digital  Simulation  of  One  and  Two-Operator 

Man-Machine  Systems 


Arthur  1.  Siegel 
J.  Jay  Wolf 
Kenneth  Crain 


prepared  for 


Engineering 
Office  of 
United 


Psychology  Branch 
Naval  Research 
States  Navy 


by 

APPLIED  PSYCHOLOGICAL  SERVICES  i 
Wayne,  Pennsylvania 


under 

Contract  Nonr-2492(00) 


March  1961 


ABSTRACT 


A  model,  which  had  as  its  aim  the  prediction  of  the  effectiveness 
of  uni-operator  man- machine  systems,  was  previously  derived  and  am¬ 
plified  by  Applied  Psychological  Services.  This  previous  model  was 
tested  against  two  independent  tasks  drawn  from  Naval  aviation  operating 
experience.  Reasonable  conformity  was  found  between  the  predictions 
resulting  from  application  of  the  model  and  operational  experiences.  The 
present  report  describes  the  extension  of  this  model  to  simulate  two-oper¬ 
ator  systems.  The  two-operator  model  may  also  be  employed  for  evaluat¬ 
ing  uni-operator  systems. 

Jn  Applied  Psychological  Services'  two-operator  model,  a  high  speed 
digital  computer  is  used  to  calculate  and  record  simulated  operator  perform¬ 
ance  data  (e,  g. ,  performance  time,  stress,  etc. )  for  every  action  of  each 
operator  and  to  yield  an  indication  of  system  effectiveness  on  the  basis  of 
these  simulations.  After  development,  the  model  was  applied  to  the  simu¬ 
lation  of  in-night  refueling  of  an  F8U  receiver  aircraft  by  an  A4D  tanker 
aircraft.  The  maneuvers  and  actions  of  the  F8U  pilot  during  approach 
and  probe  insertion  as  well  as  the  concomitant  actions  of  the  tanker  air¬ 
craft  pilot  during  this  night  task  were  simulated. 
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The  results  from  the  model  as  reflected  through  the  digital  simu¬ 
lation  were  compared  with  empirical  criterion  data  on  actual  in-flight 
refueling  success  and  were  further  evaluated  on  the  basis  of  their  com¬ 
patibility  with  logical  expectation.  The  results  from  this  initial  applica¬ 
tion  of  the  model,  presented  and  evaluated  in  this  report,  appear  to  con" 
form  with  reality  and  are  generally  reasonable.  Further  validation  of  the 
model  is  required  to  determine  the  range  and  limits  of  its  generality. 


-  ii  - 


ACKNOWLEDGMENTS 


The  authors  would  like  to  acknowledge  with  sincere  thanks  the 
several  contributions  which  others  have  made  to  this  study.  The  staff 
of  the  U.  S.  Naval  Aviation  Supply  Office,  Philadelphia,  particularly 
LCDR  R.  C.  Austin  and  LCDR  W.  F.  Wyrick,  provided  assistance  in 
arranging  for  and  operating  the  IBM  705  Data  Processing  System. 

We  are  also  indebted  to  the  personnel  of  the  Naval  Air  Station, 
Patuxent  River,  Maryland,  especially  Major  J.  Robbins,  CDR  V.  O'Rourke, 
CDR  M.  Voigt,  CDR  T.  Harwell,  and  CDR  R.  Carlquist,  for  their  coopera¬ 
tion  in  obtaining  a  detailed  description  of  the  air-to-air  refueling  operation, 
as  well  as  the  operational  criterion  data  against  which  the  predictions  from 
the  model  could  be  compared. 

Typing  and  proofreading  were  performed  by  Gail  Gensemer  and 
Estelle  Siegel. 

Finally,  we  are  indebted  to  Dr.  Max  Lund  and  Dr.  Paul  Cheatham, 
Engineering  Psychology  Branch,  Psychological  Sciences  Division,  Office 
of  Naval  Research,  for  their  support  and  understanding  of  the  problems  en¬ 
countered  on  projects  of  an  exploratory  investigational  nature,  as  well  as 
to  Dr.  Denzel  Smith,  Head,  Psychological  Sciences  Division,  Office  of  Naval 
Research,  for  his  sympathetic  resonance  with  our  attempts  to  represent  sym¬ 
bolic  and  motor  processes  digitally. 

Arthur  I.  Siegel 
J.  Jay  Wolf 
Kenneth  Crain 

APPLIED  PSYCHOLOGICAL  SERVICES 
March  1961 

-  iii  - 


TABLE  OF  CONTENTS 


Page 

ABSTRACT . .  i 

ACKNOWLEDGMENTS .  iii 

CHAPTER  I  -  INTRODUCTION .  1 

Purposes  of  Model .  1 

Other  Approaches  .  3 

Analogue  vs.  Digital  Simulation .  6 

CHAPTER  II  -  THE  MODEL .  7 

Use  of  the  Model .  7 

Input  Data,  Parameters,  and  Initial  Conditions .  11 

Initial  Conditions  and  Parameters .  14 

The  Simulation  Sequence.... .  17 

Urgency  and  Stress .  18 

Team  Cohesiveness .  22 

Subtask  Execution  Time . 24 

Subtask  Success  and  Failure .  28 

Decision  Subtasks .  30 

Other  Computer  Operations .  33 

Calculation  of  Pseudo-Random  Numbers .  37 

Calculation  of  Random  Deviates .  39 

Assumptions .  39 

CHAPTER  III  -  THE  IN-FLIGHT  REFUELING  TASK .  41 

Task  Description .  41 

Subtask  Data . 47 

Ti  and  T2  Values  Employed .  52 

Outside  Criteria .  52 

Computations  Performed .  54 

Confidence  Limits .  57 


-  iv  - 


Page 


CHAPTER  IV  -  THE  COMPUTER  AND  THE  PROGRAM .  59 

Description .  59 

The  Program .  61 

CHAPTER  V  -  RESULTS  AND  DISCUSSION .  64 

Success  Percentage  as  a  Function  of  F .  65 

Success  Percentage  as  a  Function  ofM^ .  70 

Comparison  with  Outside  Criteria .  74 

Idle  Time  and  Waiting  Time .  75 

Time  Remaining  After  Task  Completion .  77 

Terminal  and  Peak  Stress .  81 

Skipping  of  Non-Essential  Subtasks .  84 

Average  Terminal  Cohesiveness .  87 

CHAPTER  VI  -  SUMMARY  AND  CONCLUSIONS .  90 

REFERENCES  .  93 

APPENDIX  A  .  94 


-  V  - 


TABLE  OF  TABLES 


Table 

1  Summary  of  Urgency  and  Stress  Conditions  . . 

2  Example  of  Detailed  and  Intermediate  Results 

3  Example  of  Pseudo-Random  Number  Results  . 

.4  Summary  (Run  Results) . 

5  Console  Switch  Functions . 


Page 

21 

34 

35 

36 

37 


6  Task  Analysis  Data  for  In-Flight  Refueling- -Tanker .  44 

7  Task  Analysis  Data  for  In-Flight  Refueling- -Strike .  45 

8  Summary  of  Average  Execution  Times  and  Average 

Standax'd  Deviations  for  Basic  Operator-Control 

Actions  .  49 

E 

9  Calculation  51 


10  Outside  Criterion  Data  for  In-Flight  Refueling  Maneuver  ...  53 

11  Initial  Conditions  and  Parameters  for  the  In-Flight  Refueling 


Task  Simulation .  55 

12  Scaling  of  Selected  Computer  Data .  56 


13  Operating  Characteristics  of  the  IBM  705  Computing  System  60 


14 

15 

16 

17 

18 


Percentage  of  Successful  Iterations  for  Each  of  Four  F 
Values  at  Various  M^  and  Mg  Values . 

Mean  Success  Percentage  for  Various  F.  Values . 

J 

Difference  from  Average  for  Each  Run  for  Each  of  Four  F 
Values  at  Various  M,  and  M_  Values  . . 

Effect  of  M.  Variations  on  Average  Success  Percentage 
(All  Mg  Values) . 


67 

68 

71 

72 


Average  Waiting  Time  (Seconds)  for  Each  Operator  for  Each 
of  Four  Fj  Values . 


76 


-  vi  - 


Table 


Page 


19  Average  Waiting  Time  for  Various  F.  Values . 

3 

20  Average  Time  Remaining  After  Task  Completion 

(Successes  Only,  All  Simulations) . 

21  Average  Peak  Stress . 

22  Average  Terminal  Stress . 

23  Number  of  Non-Essential  Subtasks  Ignored  Per  Rim  of 

100  Iterations  . 


77 

79 

82 

33 

85 


24  Average  Terminal  Cohesiveness 


88 


-  vii  - 


TABLE  OF  FIGURES 


Figure  Page 

1  Flow  chart  of  the  two- man- machine  model .  9 

2  Average  execution  time  and  its  standard  deviation  as 

functions  of  stress .  27 

3  Probability  of  subtask  success  as  a  function  of  stress .  29 

4  Schematic  examples  of  progress  between  subtasks .  32 

5  Schematic  time  diagram  of  the  in-flight  refueling  subtasks  43 

6  Percentage  of  successful  iterations  as  a  function  of  F^  . . . .  69 

7  Average  success  probability  as  a  function  of  Mg .  73 

8  Average  time  remaining  after  successful  task  simulations  80 

9  Average  number  of  non-essential  subtasks  skipped  by 

simulated  strike  pilots  with  various  stress  thresholds 

(Mg) . 86 

10  Average  terminal  cohesiveness  as  a  function  of  Mg .  89 


-  vlii  - 


CHAPTER  I 


INTRODUCTION 


Complex  systems  in  which  a  human  is  expected  to  operate  his  ma¬ 
chine  are  often  foxmd  to  overburden  or  underburden  the  operator  after  the 
system  is  accomplished.  This  report  presents  the  results  of  the  third  in 
a  series  of  studies  by  Applied  Psychological  Services  directed  toward  the 
general  goal  of  developing  methods  for  predicting  such  system  design  mis¬ 
matches  while  man-machine  systems  are  in  the  early  design  stage.  The 
first  two  reports  of  this  series  (Siegel  and  Wolf,  1959a;  Siegel  and  Wolf, 
1959b)  described  the  development  and  application  of  a  psychological -math¬ 
ematical  model  which  enables  the  simulation  of  single  operator  machine 
systems.  The  present  report  describes  the  extension  and  application  of 
this  model  to  the  situation  in  which  a  machine,  subsystem,  or  system  is 
operated  simultaneously  by  a  team  of  two  individuals^. 

Purposes  of  Model 

It  is  the  purpose  of  this  model  to  give  equipment  designers  quan¬ 
titative  answers,  while  equipment  is  in  the  early  design  stage,  to  questions 
such  as  the  following: 

1.  Given  a  selected  machine  design,  can  an  average 
two-man  team  be  expected  to  complete  successfully 
all  actions  required  for  task  performance  within  the 
time  limits  given  for  each  operator? 

1.  The  major  similarities  and  differences  between  the  one-  and  two-man 
models  are  given  in  Appendix  A. 
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2.  How  does  task  or  system  success  probability 
change  for  slower  or  faster  teams  and  longer 
or  shorter  periods  of  allotted  time? 

3.  How  great  a  relative  stress  is  placed  on  each 
operator  during  his  performance  and  in  which 
portions  of  the  task  are  the  operators  overloaded 
or  underloaded? 

4.  What  is  the  frequency  distribution  of  each  opera¬ 
tor's  failures  as  a  function  of  various  relative 
stress  tolerances  and  team  member  speeds? 

5.  For  how  much  time  is  each  operator  idle  while 
waiting  either  for  the  other  operator  or  for  some 
outside  event  to  occur? 

Use  of  the  model  is  based  on  the  high-speed,  general  purpose  digital 
computer.  The  computer  operates  on  source  data  concerning  performance 
by  average  operators  and  on  system  parameters;  using  these  it  simulates 
each  operator  by  calculating  values  for  and  keeping  track  of  items  such  as 
his  performance  time,  subtask  and  task  success  or  failure,  stress,  and  idle 
time.  The  speed  of  arithmetic  computation,  capacity  for  storing  information 
and  the  flexibility  of  decision  making  offered  by  such  computing  devices  en¬ 
abled  the  computer,  in  approximately  3.  2  seconds,  to  simulate  the  maneuvers 
and  actions  of  a  buddy  system  in-flight  refueling  operation  which  normally  is 
completed  by  the  two  pilots  in  approximately  70  seconds.  This  task  consists 
of  13  subtasks  for.  the  pilot  of  the  tanker  aircraft  and  27  subtasks  for  the  pilot 
of  the  receiver  aircraft.  The  task  was  simulated  a  total  of  4, 400  times  by 
the  computer,  representing  44  combinations  of  pilot  types  and  conditions. 
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other  Approaches 


Alternative  approaches  to  the  problem  of  simulating  man- machine 
systems  have  been  taken  elsewhere.  Pondy  (1959)  attempted  to  present 
a  brief  description  of  a  sample  of  the  existing  unclassified  methods.  In 
that  summary,  which  presented  only  those  techniques  based  on  quantitative 
methods,  the  following  recommendation  (Hopkins  and  Williams,  1.958)  was 
presented: 


", . .  initial  systems  approaches  should  not  be  expected  to 
be  accurate  quantitative  predictions.  We  do  not  yet  know 
enough  about  general  systems  behavior  for  this  to  be  pos¬ 
sible.  Rather,  systems  models  will  probably  aid  in  making 
qualitative  predictions  and  providing  the  mathematical,  con¬ 
ceptual,  and  linguistic  framework  for  describing  systems 
behavior  realistically  and  unambiguously.  ” 


Pondy  decries  the  deficiencies  of  available  models  which: 


a.  ignore  the  question  of  measuring  or  defining  good 
performance 

b.  present  a  distinction  between  man  and  machine 
when  it  should  be  absent 

c.  are  based  on  a  methodology  which  requires  a  new 
restricted  model  to  be  worked  out  for  each  new 
problem 

While  it  must  be  clearly  admitted  that  no  universally  applicable  man- 
machine  simulation  model  now  exists,  the  above  statements  indicate  a  more 
pessimistic  picture  than  is  warranted  by  the  present  situation.  The  field  is 
being  explored  by  a  number  of  individuals  and  organizations  from  a  variety 
of  approaches. 
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One  approach  is  to  derive  the  mathematical  representations  for  an 
operator's  performance,  learning  effects  and  the  like  in  a  specific  task 
situation.  The  result  of  this  approach  would  be  a  model  which  is  not  a  de¬ 
scription  of  human  behavior,  but  a  description  of  a  particular  system  in 
which  the  human  plays  a  part.  And  the  model  may  not  be  applicable  outside 
of  the  specific  class  of  the  man-machine  task  selected.  In  such  a  model, 
the  human  may  be  represented  as  a  linear  amplifier  or  other  servo  element 
in  the  control  loop;  random  noise,  possibly  independent  of  the  input,  is  some¬ 
times  assumed  together  with  constant  reaction  time. 

Another  approach  to  simulating  the  human  is  that  of  Powers,  McFarland 
and  Clark,  as  reported  by  Mowrer  (1960).  This  approach  considers  human 
feedback  systems  as  a  "...  hierarchical  assembly  of  feedback  systems  in 
which  control  is  accomplished  thru  a  higher  system's  setting  the  reference 
levels  for  lower  systems.  "  Powers  and  his  co-workers  believe  this  model 
to  be  ". . .  an  organizing  principle,  an  overall  description  of  human  organi¬ 
zation,  that  may  lead  to  some  of  the  needed  basic  theory. . .  " 

It  is  at  this  point  that  the  present  authors  become  confused  in  trying 
to  think  through  the  work  of  Powers  et  al.  It  seems  that  a  descriptive  mod¬ 
el  should  be  built  from  and  based  on  behavior  theory.  Behavior  theory  should 
not  be  forced  into  or  squeezed  out  of  the  mold  of  an  electronic  or  mechanical 
model. 
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Another  approach  is  based  entirely  on  probability  theory,  possibly 
extended  as  a  function  of  time.  In  this  case,  analytic  expressions  are  de¬ 
rived  for  the  probability  of  successful  task  completion  as  a  function  of 
subtask  success  probabilities  and  subtask  criticality.  Thus,  the  quanti¬ 
tative  results  are  given  for  the  system  as  a  whole  and  provide  little  other 
information  on  task  relevant  parameters  such  as  points  of  stress,  waits 
or  delays,  or  operator  variations. 

Basic  studies,  initiated  in  the  relatively  new  study  of  bionics,  may 
be  expected  to  be  eventually  applicable  to  a  more  versatile  and  accurate 
prediction  method  for  man- machine  systems.  Bionics  may  be  defined  as 
the  science  of  applying  the  knowledge  of  biology  and  biological  techniques 
to  the  design  of  electronic  devices.  Perceptron  mechanisms,  neuron  simu¬ 
lation,  pattern  recognition  and  decision  making  are  areas  now  being  studied 
by  pioneer  bionic  researchers.  The  results  of  these  studies  may,  in  the 
future,  permit  a  realistic  simulation  of  human  behavior  through  extensive 
biological  simulation. 

The  Applied  Psychological  Services’  model  is  not  based  on  trans¬ 
fer  functions,  nor  is  it  wholly  dependent  upon  probability  theory.  It  con¬ 
sists,  rather,  of  a  combination  of  techniques.  The  model  provides  quan¬ 
titative  results  for  the  critical  problems  of  task  success  probability  and 
points  of  high  stress  and  also  yields  the  required  interpretive  data  such  as: 

1.  the  peak  and  terminal  stress  levels  and  on 
which  subtask  they  occurred 

2.  identification  of  non-critical  subtasks  skipped 
by  an  operator  due  to  his  high  stress 

3.  identification  of  waiting  or  idle  times 

-  5  - 


Analogue  va.  Digital  Simulation 


We  note  that  the  application  of  an  analogue  computer  to  the  feedback 
control  loop  model  is  logical  since  this  type  of  computer  operation  depends 
on  establishing  a  system  whose  properties  are  electrically  or  mechanically 
analogous  to  the  properties  of  the  equations  or  the  model  under  study.  On 
the  other  hand,  the  digital  computer  is  capable  of  much  greater  precision 
than  the  analogue  type.  While  the  analogue  computer  is  applicable  to  a  wide 
range  of  control  and  feedback  problems,  the  digital  computer  is  more  direct¬ 
ly  suited  to  those  models  whose  implementation  is  based  on  the  calculation 
of  discrete  quantities  rather  than  continuous  variables.  The  digital  calcula¬ 
tors  are  particularly  well  suited  to  simulating  the  decision  making  required 
by  operators;  they  are  quickly  adapted  from  problem  to  problem,  are  flexible, 
and  readily  available. 
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CHAPTER  II 


THE  MODEL 


Use  of  the  Model 

Prior  to  the  use  of  the  model,  an  analysis  is  performed  for  the 
man- machine  system  xmder  consideration.  The  performance  of  each  oper¬ 
ator  is  arranged  into  ordered,  discrete  actions  called  "subtasks"  and  for 
each  subtask  certain  specific  required  source  data  are  compiled.  These 
data,  together  with  the  selected  parameter  values  (e.  g. ,  the  time  allotted 
for  performance),  are  prepared  in  punched  card  form  and  introduced  into 
the  digital  computer  for  which  a  computer  program  has  been  prepared.  As 
directed  by  its  program,  the  computer  will  sequentially  simulate,  accord¬ 
ing  to  the  rules  of  the  model,  the  performance  of  each  operator  in  the  team 
on  each  subtask.  The  simulation,  consisting  basically  of  stress,  urgency, 
subtask  execution  time,  and  subtask  success  calculations,  plus  the  proper 
bookkeeping,  continues  serially  for  each  subtask  performed  by  each  oper¬ 
ator.  The  normal  sequence  of  subtasks,  whether  linear  or  non-linear,  may 
be  modified  with  complete  generality  in  the  event  that  actions  must  be  skip¬ 
ped  or  repeated  due  to  operator  failure  on  any  subtask  or  as  a  result  of  oper¬ 
ator  decisions.  A  simulation  is  completed  when  the  simulated  operators  run 
out  of  allotted  time  or  successfully  complete  the  task.  During  the  course  of 
the  computer's  "performance"  of  the  task,  results  are  recorded  by  the  com¬ 
puter  on  magnetic  tape,  and  these  data  are  later  printed  to  indicate  the  areas 
of  operator  overload,  failure,  idle  time,  high  stress,  etc. ,  for  the  given  set 
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of  selected  parameters.  Numerous  repetitions  of  the  task  with  different 
parameter  values  yield  additional  records  and  printouts.  Frequency  dis¬ 
tributions,  summarized,  and  reduced  data  are  provided  automatically  by 
the  computer,  if  desired.  Performance  graphs  and  charts  are  then  pre¬ 
pared  from  these  data.  If  alternate  designs  are  indicated  as  a  result  of 
the  analysis  of  the  resulting  data,  the  new  designs  are  similarly  prepared 
and  analyzed  in  order  to  determine  the  extent  of  improvement  brought 
about  by  the  modifications. 

The  basic  flow  chart  for  the  model  is  presented  as  Figure  1.  This 
figure  displays  the  logical  computation  sequence  performed  by  the  com¬ 
puter  during  the  simulation.  The  subscript  i  is  used  to  identify  the  sub¬ 
tasks  which  comprise  the  total  task  mission.  The  operators  are  denoted 
by  j  and  j'  which  may  assume  values  of  1  or  2,  where  j  denotes  either 
operator  specifically  and  j '  denotes  the  other  operator.  The  simulation 
is  completed  only  after  both  operators  complete  the  necessary  sequences 
of  subtasks. 
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Input  Data,  Parameters,  and  Initial  Conditions 

Following  the  reading  by  the  computer  of  its  coded  instructions,  the 
basic  subtask-input  data  are  read  and  stored  in  the  computer's  memory.  As 
shown  in  Figure  1,  twelve  items  of  subtask  input  data  exist  for  each  subtask 
(i  =  1,  2,  . . . ,  n),  and  each  operator  (j  =  1,  2).  These  subtask  data  may  be 
derived  from  such  procedures  as  task  analysis,  literature  search,  and  per¬ 
sonal  interviews.  The  required  input  data  for  each  operator  are: 

1.  average  subtask  execution  time,  t_,  the  average 

th 

time  required  by  the  j  operator  to  perform  sub- 
task  i.  This  average  value  represents  the  case 
in  which  the  operator  is  under  no  stress.  Values 
applicable  for  most  subtasks  have  been  derived 
and  presented  previously  by  Siegel  and  Wolf  (1959a). 

2.  average  standard  deviation,  vy,  under  the  no  stress 
condition  taken  around  the  t_,  for  the  average  oper¬ 
ator.  Values  for  these  data  have  also  been  previous¬ 
ly  derived  and  presented  by  Siegel  and  Wolf  (1959a). 

3.  average  subtask  probability,  p^^,  that  the  average 
operator,  j,  under  no  stress  can  perform  subtask  i 
successfully. 
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4.  indication  of  subtask  essentiality,  Ejj,  an  indicator 
specifying  whether  or  not  the  successful  perform¬ 
ance  of  subtask  i  by  operator  j  is  essential  to  suc¬ 
cessful  completion  of  the  task.  This  datum,  derived 
from  task  analytic  information,  allows  the  computer 
to  ignore  non-essential  subtasks  during  certain  "highly 
urgent"  conditions. 

5.  idle  time  requirement,  I^j,  the  point  in  time  before 
which  operator  j  is  not  permitted  to  begin  subtask  i. 

6.  indication  of  whether  subtask  i  is  a  decision  subtask 
or  a  normal  action  subtask;  the  sign  of  is  used  as 
the  indicator.  A  decision  subtask  is  an  artificial 
subtask  used  to  enable  the  computer  to  simulate  an 
operator's  decision-making  processes. 

7.  subtask  number,  (i,3)f,  to  be  performed  next  by  oper¬ 
ator  3  in  the  event  of  failure  of  subtask  i,  or  in  the 
event  the  operator  chooses  the  first  of  two  alternate 
courses  in  a  decision  subtask. 

8.  subtask  number,  djj, (mnemonic  delay)  which  must  be 
successfully  completed  by  the  other  operator  (operator 
j')  before  operator  j  can  begin  subtask  i.  By  proper 
selection  of  dy  values,  it  is  possible  to  cause  either 
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simulated  operator  to  "wait"  until  his  partner  has 
completed  a  stipulated  subtask  successfully.  Thus, 
"waiting"  for  one's  partner  is  simulated  differently 
from  time  spent  "idling"  until  a  fixed  time  event 
elapses  as  in  5  above. 

9.  subtask  number,  (i,  j)_,  to  be  performed  next  by 
operator  j  in  the  event  he  succeeds  on  subtask  i,  or 
in  the  event  he  chooses  the  second  alternate  course 
in  a  decision  subtask. 


10.  indication  of  whether  or  not  subtask  i  for  operator  j 
is  a  subtask  in  which  the  operators  communicate  with 
each  other. 


11.  time,  T^j  ,  required  to  perform  all  remaining  essen¬ 
tial  subtasks  (including  i)  at  average  execution  times, 

assuming  no  failures.  With  no  branching  or  decisions, 

E  n 
Ti 


IJ 


12.  time,  ,  required  to  perform  all  remaining  non- 
essential  subtasks  (including  i)  at  average  execution 
times,  ab»uming  no  failures. 
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The  other  main  set  of  data  required  by  the  computer  in  advance 
of  the  simulation  consists  of  the  parameters  and  initial  conditions  dis¬ 
cussed  below.  These  are  inserted  to  permit  the  adjustment  of  critical 
variables  and  the  consequent  determination  of  the  range  of  their  effects. 

Initial  Conditions  and  Parameters 

The  number  of  times,  N,  that  a  given  task  is  to  be  simulated  by 
the  computer  is  the  first  initial  condition  inserted  into  the  computer  prior 
to  the  computation  for  a  given  task.  In  order  to  simulate  intra  and  inter¬ 
individual  performance  differences,  the  simulation  of  any  individual  sub¬ 
task  is  based,  in  part,  on  a  random  effect.  Because  of  this  stochastic 
effect,  it  is  necessary  to  repeat  the  simulation  of  a  task  many  times  in  or^ 
der  to  obtain  sufficient  performance  data  for  each  set  of  conditions.  Thus, 
there  are  N  simulations  (or  N  iterations)  per  computer  "run.  " 

Another  initial  condition  is  R^,  the  number  from  which  the  com¬ 
puter  generates  subsequent  pseudo-random  numbers  needed  during  the 
course  of  the  simulation.  The  selected  for  the  first  pseudo- random 
number  in  the  first  run  is  123456789.  Subsequently,  the  last  pseudo¬ 
random  number  generated  in  one  run  is  used  as  the  first  value  in  the 
next  run. 

Parameters  are  those  initial  conditions,  selected  prior  to  a  com¬ 
putation,  which  may  be  varied  in  order  to  evaluate  either  the  model  or  a 
man-machine  system.  The  stress  thresholds,  M.,  one  for  each  operator. 
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are  examples  of  such  parameters.  The  stress  threshold  may  be  considered 
as  the  operator's  breaking  point.  For  example,  an  M.  value  of  2.  0  indicates 
that  the  operator  begins  to  become  slower  and  less  accurate  at  the  point  at 
which  he  has  more  than  twice  as  much  to  do  (at  average  speed)  as  he  has 
time  available.  Prior  to  this  point,  any  added  backlog  of  essential  subtasks 
creates  a  mental  inducement  of  stress  which  affects  operator  actions  so  that 
they  become  faster  and  more  accurate.  For  any  given  run  of  N  iterations  or 
simulations,  a  specific  stress  threshold  is  used  in  the  calculations.  The  ef¬ 


fects  of  a  change  in  M.  are  studied  by  performing  runs  in  which  these 


param¬ 


eters  assume  different  values. 


The  parameters,  T.  (j  =  1,  2),  are  the  total  times  allotted  to  each 

J 

operator  for  task  performance.  Various  computer  runs  may  be  performed 
to  determine  the  effect  of  a  change  of  these  parameters.  This  facility  is 
provided  since  the  T.  value  may  not  be  known  exactly  in  systems  which  are 
proposed  or  designed  but  not  yet  built.  In  a  two- man  team  model,  the  task 
can  be  considered  to  have  been  successfully  completed  if  both  operators 
complete  all  required  subtasks  within  the  time  specified  by  the  larger  of 
the  two  values. 

The  parameters,  F.,  which  account  for  variance  among  individuals, 

J 

are  the  individuality  factors  for  the  two  operators.  This  provides  the  abil¬ 
ity  to  simulate  an  operator  who  usually  performs  faster  or  slower  than  the 
average  operator.  F^  possesses  a  value  of  unity  for  the  average  operator. 
The  effect  of  faster,  or  more  highly  motivated  operators  (F  <  1),  and 
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slower  operators  (Fj  >  1)  in  the  performance  of  the  task  is  examined  by 
performing  several  computer  runs  with  different  values  for  these  multi¬ 
plicative  factors. 

A  run  number  is  used  to  identify  runs  and  a  trial  number  is  inserted 
to  identify  later  continuations  of  a  particular  run  in  which  all  parameters 
and  initial  conditions  are  identical  except  Rq.  This  enables  replication  on 
the  same  basic  operators.  The  trial  number  and  run  number  are  retained 
for  identification  and  subsequent  analysis. 

In  summary,  for  a  given  run  and  trial,  starting  with  Rq  as  the  first 
pseudo- random  number,  N  simulations  of  a  single  task  are  performed  by 
the  computer  with  fixed  values  for  each  of  the  parameters  Mj,  Tj,  and  Fj. 


The  Simulation  Sequence 


The  digital  computer  is  a  sequential  device  which  performs 
individual  operations  at  very  high  speeds.  Having  stored  the  program, 
parameters,  and  initial  conditions,  the  computer  begins  processing 
these  data  in  accordance  with  the  logic  presented  as  Figure  1. 

For  either  operator  and  for  any  given  subtask  after  the  first, 
the  computer  determines  which  subtask  to  perform  next  in  accordance 
with  (i,  j)  and  (i,  j).  input  data.  The  computer's  determination  of  which 
operator  to  simulate  at  any  given  time  in  the  sequence  depends  upon  the 
amount  of  time  used  by  the  operators.  In  Figure  1  (circled  c),  T^j  in¬ 
dicates  the  total  time  used  up  by  operator  j  while  "performing"  all  subtasks 
from  the  start  of  the  simulation  through  subtask  i-1.  The  operator  having 
the  smaller  value  is  selected,  and  his  next  subtask  is  simulated. 

Having  elected  to  simulate  subtask  i  for  operator  j,  the  I,,  (deci¬ 
sion)  input  is  examined.  If  the  sign  of  I.,  is  negative,  then  the  subtask  is 
a  decision  subtask  (discussed  later).  Otherwise,  the  computer  proceeds 
to  determine  whether  operator  j  must  wait  for  his  partner  before  perform¬ 
ing  Bubtask  i.  If  waiting  is  required,  the  sequence  recycles  to  the  cir- 
« 

cled  f  on  the  flow  chart  and  the  data  for  the  other  operator  (j')  are  placed 
in  proper  storage  for  processing  and  the  sequence  continues.  If  waiting 
is  not  required,  then  a  determination  is  made  as  to  whether  operator  j 
must  idle  until  1^^  simulated  seconds  have  elapsed  from  the  beginning  of 
the  simulation.  If  Idling  is  required,  the  idle  time  I^^  -  tJJ  Is  recorded, 
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totals  accumulated,  T..  set  equal  to  I..,  and  the  control  returned  to  the 

ij  13 

circled  c  to  determine  which  operator  to  simulate  next.  If  no  idling  is 
required,  a  determination  is  made  of  whether  or  not  subtask  i  is  a  com¬ 
munication  subtask.  If  so,  to  synchronize  the  operators  in  time,  the 
total  time  used  by  both  operators  is  set  equal  to  the  larger  value.  This 
act  may  result  in  a  wait  for  either  operator  and  is  treated  as  the  w’ait  de¬ 
scribed  above.  Following  the  synchronization  of  the  operators,  or  in  the 
event  the  subtask  was  not  a  communication  subtask,  control  is  transferred 
to  the  circled  h  of  Figure  1. 


Urgency  and  Stress 

Next,  one  of  three  states  of  "urgency"  is  determined.  Urgency  is 
based  upon  the  remaining  time  available  to  operator  3  for  completing  the 
task  and  the  average  time  required  to  complete  it. 


(1)  The  situation  is  non-urgent  when  (assuming  average 
speed  and  no  operator  failures),  on  the  average,  suf¬ 
ficient  time  remains  for  an  individual  operator  to 
complete  all  remaining  subtasks.  Thus,  the  non¬ 
urgent  state  exists  during  performance  of  subtask  i 
when 

^  -p  rpU 

ij  ij  -  3  '  ij 


(2)  The  urgent  state  occurs  for  either  operator  whenever 
insufficient  time  is  available  for  completing  all  remain¬ 
ing  subtasks,  provided  that  sufficient  time  is  available 
to  complete  all  remaining  essential  subtasks.  That  is, 
the  situation  is  urgent  if: 

_  U 

T,,  +  T,,  >  T.  -  T,.  and 

ij  ij  -  3  i3 

<  T  -  T^ 
ij  -  j  ij 
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These  are  based  on  estimated  average  operator  execu¬ 
tion  times  and  the  assumption  that  no  operator  failures 
will  occur.  In  this  situation  the  non-essential  subtasks 
are  ignored  by  the  computer. 

(3)  The  situation  is  highly  urgent  if  there  is  insufficient 

time  available  for  completing  even  the  remaining  essen¬ 
tial  subtasks  at  average  operator  speeds,  i.  e. ,  when 

>  T  -  T^ 
ij  3  ij 

Similarly,  in  this  urgency  state  non-essential  subtasks 
are  ignored  by  the  computer. 


Following  the  determination  of  the  urgency  condition,  the  stress  con 
dition  is  calculated  for  operator  j  in  his  simulated  performance  of  subtask  i 
The  "certainty"  in  the  operator's  "mind"  that  there  is  insufficient 
time  remaining  to  complete  the  essential  subtasks  (when  performing  at  nor¬ 
mal  speed  and  efficiency)  will  impress  a  state  of  stress  on  the  operator. 


The  model  defines  stress, 


as  a  state  of  mind  of  operator  j  just  prior 


to  his  performance  of  subtask  i.  Current  psychological  theory  suggests 


that  emotion  or  stress  up  to  a  certain  point  acts  as  an  organizing  agent  on 
behavior;  beyond  this  point  stress  acts  as  a  disorganizing  agent.  Accord- 
the  model  recognizes  an  organizing  effect  on  operator  performance 
as  long  as  s^^  is  less  than  M^,  where  is  a  threshold  value;  if  s_  equals 
or  exceeds  M^,  the  effect  is  disorganizing.  During  non-urgent  and  urgent 
conditions  s^  is  defined  to  be  equal  to  unity;  when  the  situation  is  highly 
urgent,  stress  is  defined  as  the  ratio  of  the  sum  of  the  average  remaining 


essential  subtask  execution  times  to  the  total  time  remaining: 


Thus,  basic  stress  is  the  ratio  of  how  much  is  left  to  do,  to  the 
amount  of  time  available  in  which  to  do  it. 

Table  1  summarizes  the  conditions  for  urgency  and  stress  as 
incorporated  into  the  model.  Non-essential  subtasks  are  ignored  during 
urgent  and  highly  urgent  conditions. 
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Summary  of  Urgency  and  Stress  Conditions 
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Team  Cohesiveness 


A  feature  has  been  included  in  the  two-man  team  model  to  account 
for  the  effect  of  each  operator's  confidence  in  or  cohesiveness  with  the 
other.  This  feature  attempts  to  simulate  the  confidence  of  one  operator 
in  his  partner.  Team  cohesiveness  may  also  be  reflective  of  disagreements 
in  goals  and/or  their  importance,  methods,  or  locus  of  authority.  An  oper¬ 
ator  can  often  tell  how  well  his  partner  is  performing.  When  one  operator 
"feels"  that  his  partner  is  performing  satisfactorily,  it  is  assumed  that  the 
"peace  of  mind"  this  creates  will  enable  him  to  perform  normally,  i.  e. ,  his 
execution  times  will  depend  on  his  own  stress  value,  stress  threshold,  and 
other  factors  as  previously  described.  On  the  other  hand,  if  a  partner  is 
performing  poorly,  it  might  be  expected  that  the  knowledge  of  this  poor  per¬ 
formance  will  cause  the  first  operator  to  modify  his  actions.  The  model 
causes  faster  or  slower  than  normal  execution  times  by  one  operator  if  he 
knows  his  partner  is  in  a  highly  urgent  situation.  This  is  accomplished  by 
causing  the  computer  to  add  to  the  stress  value  of  operator  j  if  operator  j' 
has  a  stress  value  greater  than  unity.  Specifically,  an  additive  A  is  cal¬ 
culated  as  follows: 


A  = 


if 


if 

if 


s  =1 

ij' 


1  <8...  <  M., 
ij '  ”  3 ' 


Sij,  >M., 
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The  value  of  A  is  added  to  the  individual  stress  value,  s_,  due  to  a  single 
operator  alone  and  the  result,  S..,  is  used  in  later  calculations  of  subtask 
performance  time,  t^^.  In  cases  where  direct  visual  contact  between  two 
operators  is  limited  or  absent,  one  operator  may  be  correspondingly  limited 
in  his  ability  to  discern  the  effectiveness  of  his  partner's  performance.  With 
a  further  reduction  in  avenues  of  communication  between  operators  (as,  for 
example,  where  radio  silence  is  maintained),  a  greater  limitation  is  to  be 
expected  in  the  knowledge  of  one  operator  concerning  the  state  of  being  of 
the  other.  Under  such  conditions,  however,  an  operator  can  gain  some 
knowledge  of  the  efficiency  of  his  partner's  performance  through  subtasks 
which  require  waiting  (simulated  by  d^^  values).  Thus,  if  operator  j  can¬ 
not  continue  the  execution  of  his  required  actions  until  operator  j '  has 
completed  subtask  i,  and  if  operator  j'  is  late  in  performing  that  subtask, 
operator  j  now  has  some  basis  for  knowing  (or  assuming)  that  his  partner 
is  functioning  poorly  to  some  degree.  This  knowledge,  in  turn,  will  affect 
operator  j's  performance  through  the  additive,  A.  Therefore,  in  certain 
two- man  team  tasks  (and  in  the  one  here  reported),  the  additive  is  com¬ 
puted  only  for  those  subtasks  requiring  waiting  (either  communication 
subtasks  or  those  for  which  the  d^^  value  differed  from  the  previous  value). 

In  addition,  an  index  of  cohesiveness,  C, is  also  calculated  for 

ij 

each  operator  on  each  subtask  as  a  measure  of  the  joint  stress  condition 
of  the  team.  It  is  the  product  of  the  stress  levels  of  the  two  operators 


normalized  by  their  respective  stress  threshold  values: 
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(s..s.  )  -  1 

_ 

(M.M..)  -  1 
J  J' 


When  neither  operator  is  under  stress,  then  C,.  assumes  a  value  of  zero. 

Should  both  operators  have  a  stress  value  equal  to  their  thresholds,  then 

C..  assumes  a  value  of  unity.  Thus,  increasing  C..  values  indicate  greater 
ij  ^3 

team  discontinuity  due  to  increased  stress. 


Subtask  Execution  Time 

Next,  the  execution  time  of  the  subtask  is  computed.  The  average 
operator  will  require  t_  seconds  to  perform  subtask  i  when  s..  equals  unity. 
In  this  case,  his  average  standard  deviation  will  be  o-^j.  Of  course,  no  two 
operators  would  be  expected  to  perform  any  subtask  in  exactly  the  same 
time  on  each  repetition,  and  no  operator  would  be  expected  to  perform  the 
same  task  identically  over  two  occasions  except  by  chance.  For  each  sub¬ 
task,  it  is  assumed  that  the  actual  subtask  execution  time,  t...  for  the  spe- 

1] 

cific  subtask,  i,  is  normally  distributed  with  mean  dependent  on  t^^  and 
standard  deviation  dependent  on  o-^j.  The  computation  of  a  reasonable  and 
realistic  specific  value  for  the  actual  execution  time,  t..,  for  each  subtask 
is  made  on  the  basis  of  a  random  selection  from  a  normal  distribution  limited 
from  below  by  a  fixed  minimum,  selected  as  0.  75  seconds.  The  computer 
accomplishes  the  selection  of  t^^  by  a  random  or  Monte  Carlo  technique. 
Pseudo-random  numbers  and  R^  uniformly  distributed  in  the  unit  interval 
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are  sequentially  generated  from  by  the  computer  using  the  power 
residue  method  as  described  in  an  IBM  manual  (1959)  and  summarized 
in  a  subsequent  section  of  this  chapter.  By  the  use  of  these  independent 
random  numbers,  corresponding  values  of  ar»  independent  random  vari¬ 
able  are  generated  having  a  distribution  function  equivalent  to  that  of  the 
normal  distribution  (i.  e. ,  normal  deviates).  This  is  done  by  the  "direct" 
technique  described  by  Box  and  Muller  (1958)  and  evaluated  by  Muller 
(1959),  and  also  discussed  in  a  subsequent  section  of  the  present  chapter. 

Thus,  if  is  the  number  of  standard  deviations  from  the  mean 
corresponding  to  the  random  numbers  generated  in  simulating  subtask  i 
for  operator  j,  then  the  actual  time  of  execution  simulated  by  the  com¬ 
puter,  t^^,  is  given  by; 


t  ■ 

ij 


'Jil  + 

(-y(Sy  .  1  -  M.)  .  K.,7,.  (2S..  .  1 


2M.)]F. 
J  J 


if  S..  <  M. 
13  J 


if  M.  <  S..  <  M.  +  1 
J  -  ij  -  J 

if  S,  >  M.  +  1 
j  J 


where  is  the  individuality  factor  described  previously  in  this  chapter. 
To  effect  these  calculations  from  a  computed  value  of  a  linear  change 
of  variables  is  made  through  the  calculation  of  =  t^^  +  which  is 

normally  distributed.  The  above  expressions  may  then  be  put  in  the  form: 


V  F 
i1  i 


l<2SlJ  ^  ‘  -  M)-y)  Fj 

13V, J  -T,jl  Fj 


if 


if  M,  <  S.,  <  M,  +  1 
j  -  ij  -  j 
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if  S,,  >  M.  +  1 
ij  J 


The  effect  of  the  above  is  to  provide  a  t_  value,  as  shown  in  Figure  2,  in 

which  the  values  of  t..  and  or..: 

^3  ^  J 


(1)  are  used  unchanged  when  stress  equals  unity 

(2)  are  decreased  with  increasing  stress  until  stress 
assumes  the  threshold  value 

(3)  are  used  unchanged  when  stress  equals  the  threshold 
value 

(4)  are  increased  linearly  with  increasing  stress  beyond 

M  until,  when  stress  equals  M  >  1,  the  contributions 

of  t..  and  cr. .  remain  constant  at  2t..  and  3o-..  respective- 
1.1  ij  iJ  13 


Mean  and  Standard  Deviation  of  the  Normal  Distribution  of  t{ 


Figure  2  Average  execution  time  and  Its  standard  deviation  as  functions  of  stress 
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Subtask  Success  and  Failure 


An  average  probability  of  successful  performance  for  subtask  i, 

p  .  is  given  as  an  input  for  each  subtask.  In  the  model,  it  is  assumed 
ij 

that  the  actual  probability  of  successful  performance  of  a  given  subtask, 

D  ..  is  a  function  of  p..,  s..,  and  the  threshold,  M.,  as  follows: 

13  1]  3 


p..  + 
I  13 


(1  -  PyXS  -  1) 


M.  -  1 
3 


if  s. .  <  M. 
13  3 


,p,.(s..  +  1  -  M.)  +  (M. 
I  i3  13  3  3 

,2p..  -  1 

^13 


if  M.<s..<M.+l 
3  -  ij  -  3 

if  s..  >  M.  +  1 
13  3 


A  review  of  Figure  3  which  displays  this  function  indicates  that  the 

probability  of  success  increases  linearly  with  stress  until  the  stress  threshold 

is  reached.  At  this  point,  the  probability  assumes  the  average  value,  p^^, 

after  which  it  decreases  linearly  until,  when  stress  has  a  value  equal  to  M.  +  1, 

3 

it  levels  off  at  a  value  which  is  decreased  from  p^^  by  an  amount  equal  to 
1  -  Pjj.  In  order  to  determine  actual  success  or  failure  for  any  subtask,  the 
computer  generates  a  pseudo- random  number,  R„,  from  R  according  to  the 
method  described  later  in  this  chapter.  The  value  of  Rg  is  thus  uniformly 
distributed  over  the  unit  interval.  The  subtask  is  considered  to  have  been 
performed  successfully  if  Rg  is  less  than  p^^;  otherwise,  it  is  assumed  that 
the  operator  failed  to  perform  the  subtask  properly.  This  implementation 


indicates  a  failure  with  probability,  p^^.  In  the  long  run.  To  facilitate  the 
calculation,  these  expressions  were  rearranged  to  indicate  success  if: 
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when  s..  <  M. 
1]  J 


(M.  -  DR,  -  s..  +  1 

]  ^3  _ 

— I  '■  ■■  <  p.. 

M.  -  s.. 

3  13 


s..  -  M.  +  R, 

-iJ _ I _ I 

s..  -  M.  +  1 
13  3 


R3+I 

2 


when  M  <  s..  <  M  +  1 
-  13  - 


when  s  >  M  +  1 

13 


The  computed  left  hand  member  of  these  inequalities  is  called  the  probability 
term  and  is  made  available  as  a  printed  result.  In  event  of  either  success  or 
failure,  input  information  indicates  the  subtask  which  is  performed  next. 


Decision  Subtaska 

If  the  test  for  indicated  a  negative  result,  then  the  subtask  is  a 
decision  subtask,  i.  e. ,  a  subtask  in  which  the  operator  makes  a  decision. 
The  purpose  of  this  type  of  subtask  is  to  simulate  the  real  world  by  providing 
for  possible  task  execution  in  other  than  a  straight,  linear  sequence.  For 
example,  an  operator  may  find  it  desirable  to  skip  one  or  more  subtasks 
with  a  certain  probability;  or  having  reached  a  critical  point,  he  may  find 
it  desirable  to  select  one  of  several  alternate  ac4on  pathways.  Such  a 
branching  in  the  sequence  may  also  be  imposed  by  external  conditions; 
the  operator  then  takes  one  of  several  paths  depending  on  these  conditions. 
Such  a  Bubtask  has  the  effect  cf  causing  the  computer  to  select  the  next  sub- 
task  (i.  e. ,  branch)  without  "consuming  operator  time.  "  (No  operator  time 
is  consumed  in  the  model  for  decision  subtasks  since  the  time  to  shift  atten¬ 
tion  between  subtasks  is  Included  in  the  time  for  each  subtask). 
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Decision  subtasks  may  be  appropriately  placed  anywhere  in  the 


sequence  of  subtasks.  In  this  case,  the  values  of  t_,  ar_,  and  essen¬ 
tiality  have  no  meaning.  The  t^  calculation  is  bypassed  and  the  last 
pseudo-random  number,  R^,  from  the  previous  subtask  is  compared 


against  the  of  the  decision  subtask.  Therefore,  the  next  subtask  to 
be  performed  as  a  result  of  the  decision,  is  the  one  normally  performed 


next  in  the  event  of  success  <i,  j)  with  probability  p...  The  subtask  in- 

s  ij 

dicated  to  be  performed  in  the  event  of  failure  (i,  is  executed  with 
probability  1  -  p^^.  Thus,  both  branching,  skipping  and  looping  are  made 
possible.  Schematic  examples  of  the  use  of  this  technique  are  shown  for 


a  single  operator  in  Figure  4,  where  solid  arrows  indicate  paths  for  suc¬ 
cess  and  dotted  arrows  indicate  paths  in  the  event  of  subtask  failure  (with 


respective  probabilities  indicated).  Boxes  indicate  action  subtasks,  and 
the  symbol  #  indicates  a  decision  subtask. 


-  31  - 


'igure  4  Schematic  examples  of  progress  between  subtasks 


other  Computer  Operations 

The  remainder  of  the  computer  operations  (starting  at  the  circled  i 
in  Figure  1)  are  concerned  with  bookkeeping,  updating  memory  values,  and 
recording  of  results»  In  general,  the  model  is  organized  so  that  at  the  com¬ 
pletion  of  calculations  for  one  run,  any  combination  of  the  following  three 
sets  of  recorded  results  may  be  produced: 

(1)  Detailed  results  -  pertaining  to  individual  subtasks 

(2)  Pseudo- random  numbers  -  pertaining  to  individual  subtasks 

(3)  Intermediate  results  -  summary  for  one  (out  of  N) 

simulations  or  iterations 

(4)  Final  results  -  summary  for  all  N  iterations 

of  a  run 

An  example  of  the  results  pertaining  to  each  subtask  (see  circled  q.  Figure  1) 
is  given  in  Table  2.  Table  2  is  a  direct  reproduction  of  data  prepared  by  the 
high  speed  printing  device  from  a  magnetic  tape  record.  The  table  shows 
detailed  results  from  one  iteration  followed  by  the  corresponding  intermedi¬ 
ate  results  (circled  u.  Figure  1).  All  times  and  stress  values  have  two 
decimal  places. 

Table  3  shows  the  pseudo-random  numbers,  R-,  R  ,  R  ,  and  R_, 

U  1  6  0 

associated  with  the  simulation  shown  in  Table  2,  together  with  and  V 
values.  Here,  leading  blanks  in  the  pseudo-random  numbers  are  zeros; 

V  and  Kj  have  two  decimal  places. 

Table  4  shows  an  example  of  the  results  printed  at  the  completion 
of  each  run. 
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Example  of  Detailed  and  Intermediate  Results 
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Example  of  Pseudo-Random  Number  Results 
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Average  of  the  N  smaller  times  remaining 


The  flexibility  in  print  formats  is  controlled  by  the  two-position 
switches  on  the  computer,  as  shown  in  Table  5, 

Table  5 

Console  Switch  Functions 

Switch _ Function _ 

911  print  all  subtask  data  in  the  event  of  a  subtask  failure 

912  print  all  subtask  data  for  only  the  first  of  N  iterations 

913  print  all  subtask  data 

916  print  R^,  R^,  R2.  R3,  K.,  V 

Intermediate  (iteration)  summary  results  and  final  (run)  summary 
results  are  always  printed,  regardless  of  switch  settings. 

Task  Success 

Task  success  occurs  when  the  operators  complete  the  required 
sequence  of  subtasks  within  the  allotted  time.  Since  each  operator  has  an 
individual  time  limit  on  his  performance  and  a  task  failure  occurs  only 
when  the  larger  of  these  limits  is  exceeded,  it  is  possible  for  the  simula¬ 
tion  to  continue  with  one  operator  (arbitrarily  selected  as  operator  1)  having 
exceeded  his  limit.  Should  this  be  the  case,  the  stress  condition  of  this 
operator  is  set  equal  to  his  threshold  value,  M.,  for  the  duration  of  the 
task  simulation. 

Calculation  of  Pseudo- Random  Numbers 

The  use  of  the  model  requires  the  sequential  generation  of  pseudo¬ 
random  numbers,  uniformly  distributed  in  the  unit  interval  0-1.  The  meth¬ 
od  selected  for  generation  of  these  numbers  is  the  power  residue  method 
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described  by  IBM  (1959).  This  general  method  as  applied  to  the  model  705 
computer  may  be  summarized  as  follows: 

1.  select  any  starting  value  of  9  digits, 

2.  form  the  product  10003 

3.  the  least  significant  9  digits  of  the  product  is  R^ 

4.  each  successive  pseudo-random  number, 

is  obtained  from  the  9  low  order  digits  of  the 
product  10003  R^ 

By  this  method,  a  given  pseudo- random  number  is  dependent  upon 
the  preceding  one  and  the  process  is  acceptable  only  since  the  quantity  of 
numbers  generated  by  the  computer  before  repetition  is  large.  The  method 
produces  approximately  50,  000,  000  nine  digit  pseudo-random  numbers 
before  repetition.  Employment  of  this  method  permits  the  exact  repetition 
of  any  simulated  task  or  subtask  if  the  initial  random  number  for  that  task 
or  subtask  is  known.  The  exact  repetition  of  a  random  process  is  thus 
facilitated  by  the  recording  of  initial  R^  values  for  each  iteration  and  en¬ 
ables  detailed  review  of  any  selected  simulated  task. 

During  the  calculations,  three  pseudo- random  numbers  are  re¬ 
quired  for  each  simulated  subtask.  Since,  for  the  in-flight  refueling 
maneuver  here  reported,  there  are  13  subtasks  for  the  first  operator 
and  27  for  the  second  (assuming  completion  of  each  task  with  no  subtask 
repetitions),  40*3  or  120  pseudo-random  numbers  were  required  for  each 
iteration.  Since  each  of  the  44  computer  runs  included  100  iterations, 
then  only  528,000  (100*120*44  »  528,000)  pseudo-random  numbers  were 
generated  during  the  course  of  the  calculations. 
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Calculation  of  Random  Deviates 


In  the  calculation  of  t..,  it  is  necessary  to  generate  values  of  a 

^  J 

random  variable  with  a  frequency  function  equivalent  to  that  of  the  normal 
distribution  (i.  e. ,  a  random  deviate).  This  was  done  by  the  direct  method 
discussed  by  Box  and  Muller  (1958)  and  by  Muller  (1959).  This  method  gives 
higher  accuracy  than  previous  methods  and  also  compares  favorably  with 
other  methods  in  computation  speed.  The  technique  is  based  on  the  avail¬ 
ability  of  two  random  numbers  in  the  unit  interval,  R  and  R  taken 

m  m+i 

from  the  same  rectangular  density  function  (see  preceding  section).  Then 
and  Xg 

X|  =  (-21n  R^)5 cos 

X2  =  (-21n  Rn,)^sin  2;rR^^j 

are  a  pair  of  independent  random  variables  from  the  same  normal  distri¬ 
bution  with  a  mean  of  zero  and  unit  variance.  This  method  is  reported  to 

-7 

produce  normal  deviates  with  a  precision  of  approximately  5  x  10  except 

“  8 

for  probabilities  less  than  4  x  10 
Assumptions 

It  is  assumed  in  the  use  of  the  model  that  the  operators  remember 
and  execute  the  correct  sequence  of  subtasks.  It  should  be  noted,  however, 
that  the  possibility  of  one  or  both  operators  neglecting  a  subtask  or  of  re¬ 
arranging  the  performance  of  a  sequence  of  subtasks  may  be  studied  by 
additional  runs  using  these  different  sequences,  i.  e. ,  assuming  new  sub¬ 
tasks  or  subtask  sequences. 
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Similarly,  a  change  in  the  predetermined  sequence  of  subtasks  by 
either  or  both  operators  is  conceivable  in  the  event  of  emergency.  Such 
a  dangerous  situation  may  result  from  operator  action  or  an  external  event 
during  the  task.  In  either  case,  it  may  be  assumed  that  the  operators,  upon 
noticing  the  danger,  will  abandon  their  normal  tasks  and  take  up  the  emer¬ 
gency  sequence  of  subtasks  associated  with  the  problem  of  survival,  and  the 
sequence  of  operations  will  change.  Thus,  the  simulation  of  dangerous  con¬ 
ditions  need  not  be  especially  provided  for  as  an  integral  part  of  the  model 
since  the.  danger  condition  may  itself  be  studied  using  the  model.  This  is 
done  by  establishing  special  danger  sequences  to  be  simulated.  Therefore, 
this  situation  does  not  limit  the  model. 

It  must  also  be  assumed  that  p^^,  andy^^  are  independent  of  whether 
the  subtask  is  being  performed  for  the  first  time  or  is  being  repeated  due  to 
a  previous  subtask  failure.  However,  it  is  noted  that  upon  repetition,  less 
time  will  remain  for  the  operator,  possibly  affecting  the  stress  and  conse¬ 
quently  affecting  p^^,  t^^,  and  o-.^. 
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CHAPTER  III 


THE  IN-FLIGHT  REFUELING  TASK 

Task  Description 

The  first  task  selected  for  simulation  using  the  two- man  model 
described  in  Chapter  II  is  maneuvering  two  in-flight  aircraft  into  the 
position  required  prior  to  the  transfer  of  fuel  from  one  to  another.  The 
first  operator,  j  =  1,  is  selected  to  be  the  pilot  of  the  tanker  aircraft  and 
the  second  operator,  j  =  2,  is  the  pilot  of  the  ship  to  be  refueled  (strike 
aircraft).  The  objective  is  the  mid-air  insertion  by  the  second  operator 
of  a  probe  into  a  drogue  extended  by  the  pilot  of  the  tanker  aircraft.  The 
actual  passing  of  fuel,  a  largely  mechanical  action,  is  not  simulated.  The 
airplanes  involved  in  the  present  series  of  flights  were  an  F8U  receiver 
and  an  A4D-2N  tanker.  The  probe  through  which  the  fuel  is  passed  is  of 
the  "cobra"  type  (retractable).  It  is  mounted  at  the  side  of  the  cockpit  of 
the  F8U  and  extends  forward  at  about  the  pilot's  shoulder  level.  In  all  cases, 
the  aircraft  were  flying  abreast  at  the  start  of  the  run  and  the  probe  of  the 
strike  aircraft  was  extended  prior  to  initiation  of  the  run.  In  order  to  de¬ 
rive  the  sequence  of  subtasks  involved,  together  with  the  relevant  auxiliary 
data,  four  experienced  pilots  were  first  asked  to  list  the  subtasks  involved. 
These  four  separate  analyses  were  then  synthesized  into  a  composite  best 
estimate  and  resubmitted  to  the  pilots  for  review.  Following  this  review, 
the  analysis  was  revised  in  accordance  with  their  suggestions  and  criticisms 
and  resubmitted  for  further  review.  At  this  point,  the  pilots  unanimously 
agreed  on  the  outlined  procedures,  and  the  resultant  sequence  of  subtasks 
was  adopted. 
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Figure  5  is  a  presentation  against  a  timeline  of  the  subtask  sequence 
for  both  operators.  Such  a  formulation  has  been  found  very  useful  in  organ¬ 


izing  sublask  datarfoir  the  model.  In  this  figure,  the  time  relationships  of 
performance  of  the  two  operators  are  shown  schemaiically,  using  average 
execution  times,  and  assuming  no  subtask  failures.  Average  waiting  times, 

operator  time  limit  values,  (T.),  and  decision  probabilities  are  also  included. 

J 

Tables  6  and  7  present  the  complete  task  analysis  for  operators  1  and 
2  respectively. 

At  the  start  of  the  task,  the  tanker  and  the  strike  aircraft  are  as¬ 
sumed  to  be  flying  abreast  of  each  other  at  a  rate  greater  than  that  optimal 
for  in-flight  refueling.  For  the  purposes  of  the  present  simulation,  it  is 
further  assumed  that  the  pilot  of  the  tanker  aircraft  is  aware  that  refueling 
is  to  take  place,  but  has  not  prepared  for  the  task  by  reducing  airspeed  or 
by  other  actions. 

Initiation  of  the  task  takes  place  when  the  pilot  of  the  strike  air¬ 
craft  reports  "Ready  to  refuel"  (i  =  1,  j  =  2).  At  the  time  of  this  report 
the  tanker  and  the  strike  aircraft  are  abreast  of  each  other.  The  tanker 
pilot  acknowledges  by  reporting  "Ready"  to  extend  drogue  (i  =  1,  j  =  1), 
and  reduces  airspeed.  It  may  be  assumed  that  the  strike  aircraft  reduces 
power  at  the  same  time  as  the  tanker  but  that  an  additional  reduction  is 
necessary  to  bring  the  strike  somewhat  behind  the  tanker  after  the  latter 
has  attained  a  speed  optimal  for  the  task.  The  execution  of  this  action  by 
the  strike  aircraft  (i  »  2,  Table  7)  is  dependent  on  the  tanker's  attainment 
of  a  stable  speed  (l.e. ,  the  tanker  pilot's  completion  of  his  third  subtask). 


and  hence  this  subtask  has  a  non- zero  d^  value  for  the  strike  aircraft. 
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Task  Analysis  Data  for  In-Flight  Refueling- -Strike 


C 

o 


Q 

U 


u 

o 


i 


a 


M  £ 
u  JZ 

» 


c 

o 


C  -W 

o  0 

U  •w  ^  CA  U 

0)  (U  M  § 

O  <lj  o 


0) 

u  « 

fSjd 


c 
o 

4)  -H 

^  ^  ^  ^  0)  4^ 

o  U  O  O  •£:  o 

.H  ••<4  y  ^ 

U  ^  *-t  ^  u 

4}  tn  n  tf)  n  E  4) 

Jic9  J 


O 

> 

u  u 

4)  4) 

>  « 


4;  -H 

^  ^  ^  ^  O  4^ 

O  O  U  U  «c  D 

•  H  —4  ..^  'H  ^  > 

U  4-f  W  4^  4^  ^  U 

0)  0)  n  10  n  E  4) 

>  >«>•>,>,  3  0) 

O  O  O  O  j5  ^ 

»  p  CJ 


n  C4  • 


O  O  O  VO  00 


c« 


w  tv  w 


CO  .H  r)  ^  «  » 


00  CD  00  CO  O  ^ 

^OOOOO  OOOOOOo 

I  t  »  t  I  I  t  f  I  I  t  It 


^  ^  ^  ^  ^  ^  o 


^  ^  o 


OOOOOOO 

I  I  I  I  I  I 


i/)tvevcr)00  OOOOOc^tv  OO  OoOOOD4tv 


Si 


CO  o 
€0  CO 


O) 


tv 


CO  04  o  m  c  o 
OI  C4  ^  -H  04 


coco 


tv  Cv  Cn,  Cv  CO  ^ 


u 


«a 


*b 


9 

s 


M 

I?- 

w 


^OO  O  O  OOOOOO  OOOOOOO  oo  oopoooo 


04(0^  CO  ^^C0000^4  cotvf^f^tveo 

*-4C*4^ 


0«-4  C4COCOCOCOf<^ 
C404  C^CMM04C4C^ 


MMD  M  4/)  cocvfloo^«-4  csa*^4ocoor«>o  oo  ^co^toocoo 

•H  ^  *-4  ^  ^  ^  ^  ^ 


^04  ^4C4^4^4^^4^ 


oo  O  o  OOOOOO  OOOOOOo  oo  OOOOOOO 


o  *-4  ^  o  o 


^  »-4  «H  «-4  O  ^ 


o  eo  o 


CD  CDCfiCDCDCDCD  CDCDCDCDCDCDCD  CDCD 


^  ^  ^ocDinoo  ooDoDooeomfs. 

OOO  O  O  ^000)000 


o  o  o 


OOOOOO 


(/>  to  wo  40  9>  O 
OOOOOOO 


COO  oooeoeocDho^ 

<7)0  OtOiOiOUlOO 
oo  OOOOOOO 


S  X  s 
•  •  • 
o 


OOOOOOCDOO  COOOQOOOCDCDO  ODO  QDODODOOflO 

^^^evoo  ^o 

ooooocn  OOOOOOo  ooooooo 


CO  o 
tv  %n 


CD  O  O 


M  00  o  00 


CO  CD  V  ^ 

8 

t 

8  8 

•m  Q  w 

0  t  I 

lilil  J, 

t:  ^  sg  4<.a  ^-a 

8.i  g“  ilS  i|2 

ce  Ala'S  a*  6t 


n  to  to 

It 

•? 


o  o 
^  o  o 


O  00  CD  OD  CD  ^  C^| 

rj  CO  o  ro  r>  ^  ^ 


o  o 

to  to 


o  00  00  00  00  *H  M 
pi  ri  r>  CD  r>  ^  ^ 


im 


^1-31 


u 


M 

•3  ^ 

s  I 

4M  ^  M 

o  e  ja 


i,  U] 

3mm 

J  il 

i  A  A 


3  3 

11 


^  D 
O 


&  O  D 


1111 


O 

s 

rs 

U  04 
D  O 

S-3 


w  O 
D 


^  M  *4  4.4  SM 

^  ^  ^  ^ 


0  0  0 


'•  1 


I  :iiii 
II.I.S'l 


•■5  ^ 

>  _  M  ►  Jj 


nm 


8 

•rs 

SIS' 

S-3 


»• 

> 


|i miiliia  U 

ii:Pe-oAAAAAi^Oh.Ad3AAAAAii:6ls. 


*^Mr>  ^  »n  u>Ka><ne>^  «>4rt«4.mu)t»-cD 


-  45 


o  o 
•“«  n 


•-4  M  CD  ^  tn  CD  fv 
C4  C4  C4  Cs|  C4  C4  C4 


A  d..  change  is  again  shown  for  the  strike  aircraft  at  subtask  5 
because  the  strike  pilot  cannot  observe  the  fully  extended  drogue  until 
the  tanker  pilot  has  completed  his  subtask  6,  i.  e. ,  has  actually  extended 
the  drogue.  Upon  seeing  the  extended  drogue,  the  strike  pilot  moves  his 
aircraft  astern  of  the  tanker. 

After  the  period  of  observation  of  the  motion  of  the  drogue  (j  =  2, 
i  =  11,  20),  the  strike  pilot  closes  in  for  engagement.  If  failure  occurs 
on  the  first  three  of  four  attempts  to  adjust  heading  and  attitude  correctly 
(i  =  13-16  or  22-25),  it  is  assumed  that  the  failed  subtask  is  simply  re¬ 
peated.  If  the  fourth  attempt  is  failed,  however,  it  is  assumed  that  the 
strike  pilot  reduces  power  (i  =  19),  again  observes  the  motion  of  the 
drogue  (i  ■  20)  for  a  short  time,  and  again  proceeds  to  close  in. 

Subtask  10  is  a  "decision  subtask"  for  the  strike  pilot  and  branch¬ 
ing  occurs.  This  subtask  was  inserted  to  cause  a  decision  by  the  computer. 
Eighty  per  cent  of  the  time  the  computer  considers  subtask  20  next.  Twenty 
per  cent  of  the  time  the  computer  considers  subtask  11  next  (see  Figure  5). 
The  purpose  of  this  branching  is  to  provide  for  two  different  amounts  of 
time  being  spent  on  "observing  steadiness  of  drogue"  (i  =  11,  20).  This 
allows  differential  observation  time  as  might  be  required  in  accordance 
with  varying  air  turbulence.  With  the  exception  of  this  difference  between 
the  initial  subtasks  of  the  two  branches,  the  subtasks  of  both  branches  are 
identical.  It  should  be  noted,  however,  that  if,  on  the  first  time  through 
the  task,  the  decision  is  made  to  follow  the  branch  headed  by  subtask  11 
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and  if,  on  the  last  subtask  of  that  branch  (i  =  18),  a  probe  insertion  failure 
occurs,  the  computer  takes  the  second  (i  =  20)  branch  on  the  next  attempt. 

It  is  assumed  in  this  case  that  the  previous  observations  of  drogue  motion 
will  be  recalled  and  applied.  Upon  failure  to  execute  the  last  subtask  of 
the  subtask  20  branch,  that  same  branch  is  followed  again  until  success  is 
finally  achieved. 

Further  activity  of  the  tanker  pilot  is  relatively  straightforward. 

His  first  subtask,  that  of  acknowledging  the  strike  pilot's  report,  is  accom¬ 
plished  only  after  completion  of  that  activity  by  the  strike,  and  hence  d^^  =  1. 
Subsequent  activity  of  the  tanker  can  occur  at  any  time  after  the  completion 
of  subtask  1.  This  activity  involves  the  reduction  of  power  until  the  optimal 
speed  for  the  task  is  attained,  the  performance  of  the  proper  sequence  of 
actions  for  permitting  fuel  transfer,  and  in  general  keeping  his  aircraft  fly¬ 
ing  steadily. 


Subtask  Data 


The  values  of  t^^  and  for  each  subtask  of  the  total  in-flight  refuel¬ 
ing  task  are  given  in  Tables  6  and  7.  With  the  exception  of  the  values  for 
thumb  wheel  setting  (trim)  and  communication,  every and  is  the  same 
as  that  employed  in  previous  applications  for  the  Applied  Psychological 
Services'  one-man  model.  The  method  by  which  these  values  were  derived 
has  been  described  previously  (Siegel  and  Wolf,  1959a;  1959b).  Briefly, 
the  tj^j  and  data  for  individual  subtasks  were  derived  by  doubling  such 
values  obtained  from  a  literature  review  of  representative  laboratory 
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experiments  and  by  adding  a  constant  (0.  6  seconds  to  t_;  0.  4  seconds  to 

"a  )  to  account  for  the  time  required  for  shift  of  attention  from  one  dis- 
13 

Crete  response  to  another. 

Consider  the  two  t..'s  and  <t. .'s  which  were  not  previously  employed. 

13  13 

For  the  thumb  wheel  adjustment  (trim),  the  same  t..  and  the  same  ct..  were 

13  13 

used  as  those  calculated  on  the  basis  of  the  experimental  literature  for  set¬ 
ting  a  toggle  switch  (t ..  =  1. 1;  o,.  =  0.  76).  This  procedure  was  felt  to  be 

13  13 

reasonable  since,  in  the  case  of  the  trim  action,  the  time  required  to  move 
a  thumbwheel  should  approximate  the  time  required  to  throw  a  switch. 

With  respect  to  the  t..  and  cr..  values  for  communication  subtasks, 

13  13 

the  basic  time  required  per  word  was  taken  to  be  0.  67  seconds.  This  es¬ 
timation  is  based  on  the  data  of  Miller  (1951),  who  reported  the  average 
speaking  rate  to  be  1.  5  words  per  second.  Adding  the  constant  0.  6  results 
in  an  approximate  value  of  1.  3  seconds  for  one  word,  or  0.  66  N  +  0.  6  sec¬ 
onds  for  N  words.  The  value  for  verbal  report  was  arbitrarily  selected 
to  be  0.  34  seconds  per  word  plus  the  constant  0.  4  seconds.  A  summary  of 


all  ty  and  data  for  basic  control  actions  is  given  in  Table  8. 
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Table  8 

Summary  of  Average  Execution  Times  and  Average  Standard  Deviations 
for  Basic  Operator-Control  Actions _ 

Average  Execution  Time  Average  S^ndard  Deviation 


t.. 

( seconds) 

a. . 

13 

( seconds) 

Set  Toggle  Switch 

1. 1 

0.76 

Set  Rotary  Control 

8.  6 

3.  00 

Push  Button 

4.  2 

1.  02 

Lever  (throttle)  Setting 

3.0 

0.  48 

Joystick  Setting 

3.  8 

0.  48 

Read  Instrument,  N  Instruments 

0.  6N  +  0.  6 

0.  2N  +  0.  2 

Trim 

1.  1 

0.  76 

Communication,  N  Words 

0.  66N  +  0.  6 

0.  34N  +  0.  4 

Minimum  Value 

0.75 
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Very  low  success  probabilities  are  associated  with  certain  of  the 
subtasks  (e.g. ,  joystick  and  trim  settings).  In  these  multiple  action  sub¬ 
tasks,  several  trials  of  the  same  action  are  usually  required  in  order  to 
gain  a  given  probability  of  success,  but  a  single  successful  action  at  any 
time  may  be  sufficient  for  subtask  success.  Hence,  these  subtasks  were 
organized  for  the  computer  as  subtasks  requiring  a  single  control  action 
with  a  relatively  low  success  probability.  The  actual  determination  of  a 
probability  of  success  on  any  single  trial  was  made  as  follows: 


If  p  is  the  probability  of  success  on  a  single  trial 
and  p*  is  the  probability  of  at  least  one  success  after  n 
trials,  then 


The  d,,,  E,.,  I,.,  (i,  j),  and  (i,  j)  data  were  determined  from  the 
ij  ij  ij  f  s 

E  N  — 

basic  task  analysis.  The  T,,  and  T,.  data  were  obtained  from  t, ,  and 

ij  ij  ij 

E^j  data.  An  example  will  serve  to  demonstrate  the  method  of  calculating 

E  N  E 

Tjj  and  T^^  data.  Consider  i.e.,  the  average  time  required  by  the 

second  operator  to  complete  his  task  starting  at  the  beginning  of  subtask  1. 


This  was  calculated  by  a  weighted  addition  of  t^^  for  essential  values  as 

E 

shown  in  Table  9.  In  calculating  T^^  ,  when  a  non-essential  subtask  ex¬ 
ecution  time  is  less  than  1.5  seconds  (e.g. ,  i  =  26),  1.5  seconds  was 


assumed. 


Table  9 


Calculation  of  T 

X  M 


i 

Average  time  spent 

Factor 

Note 

Totals 

1 

2.  6 

wait  for  j  =  2 

13.  9 

2 

6.  0 

3 

1.5 

4 

1.  5 

100% 

Always 

5 

1.  2 

performed 

6 

3.8 

7 

3.0 

8 

3.  8 

9 

1.5 

Total  X  factor 

38.8 

11 

10.  0 

12 

3.  0 

Performed 

13 

3.  8 

20% 

20%  of  the 

17 

1.5 

time,  see 

18 

1.  2 

Figure  5 

Total  X  factor 

3.9 

20 

3.  0 

21 

3.  0 

22 

3.  8 

80% 

See  Figure  5 

26 

1.5 

27 

1.  2 

Total  X  factor 

10.  0 

Alternate  path 

16 

3,0 

performed  3% 

20  •  27 

12.  5 

3% 

of  time,  see 

Total  X  factor 

Figure  5 

0.5 

p 

Grand  Total  =  53. 2 

X  « 
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T  and  T  Values  Employed 
1.  « 

The  values  of  T  and  T  were  determined  on  the  basis  of  estimated 
proficiency  of  highly  experienced  pilots.  These  estimates  were  normalized 
to  an  expectancy  for  the  average  pilot. 

Outside  Criteria 

In  order  to  determine  the  degree  to  which  the  results  obtained  by 
the  model  agree  with  reality,  data  were  collected  which  indicate  the  degree 
of  in-flight  refueling  success  achieved  by  pilots  of  known  capability.  These 
data  are  given  in  Table  10  as  the  number  of  "hits"  (successes)  and  "misses" 
(failures)  out  of  a  total  of  16  flights.  A  "hit"  is  defined  as  the  successful 
engagement  of  the  probe  on  the  first  attempt.  Since  10  of  the  16  flights  re¬ 
sulted  in  "hits,  "  the  probability  of  task  success  associated  with  these  pilots 
is  calculated  as  0.  625. 
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Table  10 


Run 

Outside  Criterion  Data  for  In-Flight  Refueling  Maneuver 

Misses 

Altitude  - 
(Feet) 

Indicated  Air  Speed 
(Knots) 

Hits 

1 

20,000 

250 

1 

- 

2 

20,000 

250 

1 

- 

3 

20, 000 

250 

- 

1 

4 

20,  000 

250 

- 

1 

5 

25,000 

245 

1 

- 

6 

25,000 

245 

1 

- 

7 

25,000 

260 

1 

- 

8 

25,000 

260 

- 

1 

9 

31,500 

240 

1 

- 

10 

31,500 

250 

- 

1 

11 

31,500 

260 

- 

1 

12 

31,500 

260 

1 

- 

13 

35,000 

255 

- 

1 

14 

35,000 

255 

1 

- 

15 

35,000 

255 

1 

- 

16 

35,000 

255 

1 

- 

Total 

10 

6 
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Computations  Performed 


Forty-four  computer  runs  were  made,  each  consisting  of  100 
simulations*.  This  value  for  the  initial  condition,  N,  was  selected  as 
a  compromise  between  reasonable  computational  time  and  stability  of 
resultant  data.  Each  run  consumed  approximately  five  minutes  and 
twenty  seconds  of  computational  time,  exclusive  of  the  time  required 
on  auxiliary  equipment  used  in  listing  the  results. 

The  actual  calculations  performed  were  accomplished  over  several 
periods  of  computer  operation.  After  each  group  of  runs  was  completed, 
the  results  were  reviewed  to  determine  the  parameters  to  use  in  the  next 
calculations.  The  parameter  values  used  for  the  44  runs  are  shown  in 
Table  11.  The  location  of  the  decimal  point  indicating  the  range  of  per¬ 
missible  values  in  the  pertinent  variables  used  in  the  calculations  is  given 
in  Table  12. 


*  In  addition,  a  large  number  of  unreported  runs  were  made  to  assemble, 
verify,  and  reassemble  the  computer  program. 
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Table  11 


Initial  Conditions  and  Parameters  for  the  In-Flight  Refueling  Task  Simulation 


T.  =  41. 6  seconds 
T^  =  70.  0  seconds 


100  iterations 
123456789 


1.5 

1.25 

1.5 

3.0 

4.0 

1.5 

3.0 

4.0 

1.5 

3.0 

4.0 


1.25 

1.5 

1.5 

1.5 

1.5 

3.0 

3.0 

3 . 0 

4.0 

4.0 

4.0 


1.5 

1.25 

1.5 

3.0 

4.0 

1.5 

3.0 

4.0 

1.5 

3.0 

4.0 


l.l 

if 

{•? 

38 

i.l 

1  fi 

9 

40 

V  t  V 

3.0 

11 

44 

n 

4.0 

1.5 

1.25 

1.5 

3.0 

4.0 

1.5 

3.0 

4.0 

1.5 

3.0 

4 . 0 

1.5 

1  25 

1.5 

3.0 

4.0 

1.5 

3.0 

1:? 

3.0 

4.0 


i.l 

1.1 

1.1 

1.1 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

1.3 

U 

1.3 

1.3 

1.3 

J-3 

1.3 

1.3 
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Table  12 


Confidence  Limits 


Each  run  of  N  =  100  simulations  yielded  results  indicating  the 
number  of  successes  and  failures  from  which  a  probability  of  success 
(or  failure)  was  determined.  Of  course,  greater  confidence  can  be 
placed  on  this  probability  if  a  larger  value  for  N  is  selected.  This 
leads,  then,  to  the  question:  what  confidence  can  be  placed  on  the  spe¬ 
cific  values  of  success  probability  which  result  from  each  computer 
run?  To  answer  this  question,  confidence  limits  may  be  calculated 
according  to  the  method  of  standard  error  of  percentages.  As  stated 
in  McNemar,  1949: 

", , .  it  often  happens  that  the  research  worker  can 
easily  classify  individuals  only  on  the  basis  of  pres¬ 
ence  or  absence  of  a  certain  characteristic  (success 
or  failure  cf  a  task). . .  but  not  measured  in  a  grad¬ 
uated  manner.  When  individuals  are  classified  into 
categories  on  the  basis  of  some  characteristic  or 
attribute  it  is  usually  desirable  to  reduce  the  fre¬ 
quencies  to  percentages. . . the  given  percentage  is 
based  on  a  sample,  presumably  random,  of  a  defined 
population  and  we  are  faced  with  the  problem  of  mak¬ 
ing  an  inference  from  the  sample  value  to  the  popula¬ 
tion  value,  i.  e. ,  from  P  to  p*,  where  P  stands  for  the 
observed  percentage  and  p*  stands  for  the  percentage 
of  the  defined  population,  who  show  the  characteristic 
. .  .the  standard  error  of  percentage  will  be  given  ap¬ 
proximately  by:  =  P(^00~P)  . 

In  the  long  run  one  would  be  correct  95%  of  the 
time  in  concluding  that  the  population  value  lies  with¬ 
in  the  limits  P  +  1. 96  o-p,^.  " 

The  99%  confidence  limits  are  P +2.58  Cpjjt;  the  .68%  confidence  limits 
are  P  +  o-p^,  (It  is  not  safe  to  use  o-p,*,  for  setting  confidence  limits  for 
population  values  when  extreme  percentages  are  involved. ) 
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Errors  of  largest  magnitude  are  experienced  at  a  probability  of 
0.5.  For  this  particular  case  with  N  =  100,  the  one  sigma  confidence 
limits  are  0.  50  +  0.  05  and  95%  confidence  limits  are  0.  50  +  0.  098.  For 
the  case  of  success  probabilities  of  0.  25  and  N  =  100,  the  68%  confidence 
limits  are  0.  25  +  0.  043  and  the  two  sigma  limits  are  0.  25  +  0.  085. 
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CHAPTER  IV 


THE  COMPUTER  AND  THE  PROGRAM 


Description 

The  computational  system  employed  by  Applied  Psychological 
Services  in  the  present  study  is  the  model  705  Data  Processing  System 
manufactured  by  the  International  Business  Machines  Corporation.  The 
facility,  located  at  the  U.  S.  Naval  Aviation  Supply  Office,  Philadelphia, 
was  employed.  The  705,  a  large  scale  high-speed  system,  is  composed 
of  an  integrated  set  of  record  reading  and  writing  devices  interconnected 
through  a  central  processing  and  control  unit.  Input  to  the  system  can  be 
from  magnetic  tape  or  punched  cards.  Output  is  in  the  form  of  magnetic 
tape,  punched  cards,  or  printed  reports.  Data  entered  into  the  system  or 
processed  by  the  system  may  be  letters  of  the  alphabet,  decimal  numbers, 
or  any  of  eleven  punctuation  marks  or  symbols.  Detailed  operating  tech¬ 
niques  and  programming  examples  are  given  in  the  IBM  references  (1958, 
1959).  A  summary  of  the  pertinent  features  of  the  system  is  given  in  Ta¬ 
ble  13. 
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The  Program 

The  work  accomplished  by  the  705  in  solving  a  problem  or  process¬ 
ing  data  consists  of  the  high  speed  execution  of  many  instructions.  The 
entire  set  of  instructions  used  in  solving  a  problem  forms  a  program  for 
the  computer.  Instructions  for  a  given  procedure  are  stored  in  the  memory 
of  the  machine.  These  instructions  are  referred  to,  one  at  a  time,  in  the 
sequence  required  for  handling  each  problem.  Each  instruction  not  only 
specifies  the  functional  operation  to  be  performed,  but  also  directs  the 
operands  and  results  into  appropriate  channels.  Provision  is  possible 
in  programming  for  alternative  routines  in  which  the  "logical"  features 
of  the  machine  choose  between  two  separate  courses  of  action.  In  this 
case,  the  control  operations  are  said  to  be  conditional.  By  providing  a 
stored  program  with  the  ability  to  control  its  own  course  of  execution, 
these  conditional  operations  immeasurably  increase  the  scope  of  the  sys¬ 
tem. 

At  the  start  of  each  procedure,  the  program  of  instructions  is  read 
into  the  memory  from  tape  or  cards  and  is  stored  for  use  with  each  opera¬ 
tional  subtask.  This  one  entry  of  instructions  suffices  to  set  up  all  units. 
Each  time  an  operation  is  performed,  the  705  takes  the  instruction  from 
its  memory,  decodes  and  executes  the  instruction  and  then  refers  to  its 
memory  for  the  next  instruction. 
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The  model  as  programmed  will  accommodate  a  task  consisting  of 
100  subtasksj  including  decision  subtasks,  for  each  operator.  Of  the 
40,  000  memory  locations  available,  25,  000  are  used  in  the  program. 

The  precise  distribution  of  memory  location  employment  is: 


Memory  Location 
0-  1,300 

1,  301  -  8,500 

8,501  -  19,430 
19,431  -  22,005 
22,006  -  25,000 


Content 

reading  and  writing  routines 
instructions 

input  and  output  records  and  working 
storage 

floating  point, sub -routines  (machine 
generated  instructions) 
constants 


The  program  was  written  symbolically  and  assembled  for  computer 
operation  using  the  Autocoder  System.  The  IBM  705  Autocoder  System 
(1957)  makes  available  a  greatly  simplified  technique  for  instructing  the 
machine  (i,  e. ,  it  is  an  assembly  program  that  automatically  converts  or 
assembles  the  programmer's  symbolic  instructions  into  actual  conmuter 
instruction).  Without  any  simplified  programming  techniques,  a  human 
programmer  must  write  instructions  in  actual  machine  language.  This 
procedure  is  difficult,  time  consuming,  and  subject  to  clerical  error. 
Moreover,  it  requires  a  monumental  effort  to  keep  account  of  the  proper 
address  portion  of  the  instructions.  A  program  of  as  many  as  3,  000  in¬ 
structions  written  in  this  manner  is  difficult  to  read  or  to  analyze  for 
corrections  and  additions. 
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The  most  distinguishing  feature  of  the  Autocoder  System  is  its 
ability  to  handle  "macro-instructions.  "  A  macro-instruction  (special 
Autocoder  instruction)  permits  one  instruction  to  take  the  place  of  sev¬ 
eral  705  instructions.  The  Autocoder  also  systematically  checks  the 
instructions  written  by  the  programmer.  Upon  detection  of  errors,  the 
programmer  is  notified  by  typed  messages  during  the  assembly  process. 
In  some  cases,  the  Autocoder  diagnoses  the  intention  of  the  programmer 
and  corrects  the  error. 
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CHAPTER  V 


RESULTS  AND  DISCUSSION 


The  fundamental  research  reason  for  applying  a  model  such  as 
that  here  described  is  to  gain  insight  into  its  validity.  If  the  validity  of 
the  model  can  be  established,  the  model  may  then  be  used,  in  accordance 
with  its  objectives,  for  predictive  purposes  in  proposed  systems  or  in  the 
early  developmental  stage  of  a  system. 

The  validity  of  such  a  model  may  be  considered  from  several  points 
of  view.  First,  the  psychological  concepts  and  their  mathematical  repre¬ 
sentations  may  be  examined.  To  the  extent  that  the  user  of  the  model  ac¬ 
cepts  these  concepts  and  their  representations,  to  that  extent  will  the  model 
be  acceptable  to  him.  The  psychological  concepts  and  the  method  of  their 
mathematical  and  digital  representations  have  been  presented  in  previous 
sections  of  this  report. 

A  second  approach  to  questioning  the  validity  of  such  a  model  is  to 
investigate  how  the  results  from  the  model  agree  with  other  reality  ex¬ 
perience.  The  comparison  of  the  model  with  reality  experience  may  be 
qualitative,  i.  e. ,  the  agreement  of  the  model  with  common  sense  expec¬ 
tation,  or  it  may  be  quantitative.  Both  approaches  are  taken  in  the  current 
chapter.  The  results  are  presented  and  discussed  with  empirical  and 
qualitative  focus  on  each  of  the  following  topics; 
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1.  the  percentage  of  successfvil  refuelings 

2.  success  percentage  as  a  function  of  stress  threshold 

3.  comparison  of  these  success  data  with  outside  criteria 
data 

4.  the  amount  of  operator  waiting  and  idle  time  during 
the  simulated  task 

5.  the  amount  of  time  remaining  to  each  member  of  the 
simulated  team  after  task  completion 

6.  the  peak  stress  of  the  operators  during  each  simulated 
refueling  and  at  the  end  of  the  simulation 

7.  the  number  of  non-essential  subtasks  ignored  by  the 
operators 

8.  the  team  cohesiveness 

9.  the  number  of  subtasks  failed  by  each  operator 

Success  Percentage  as  a  Function  of 

Success  in  the  task  is  defined  as  the  proper  seating  of  the  probe 
by  the  pilot  of  the  strike  aircraft  into  the  drogue  extended  by  the  pilot  of 
the  tanker  aircraft.  This  involves  the  successful  completion  of  at  least 
all  essential  subtasks  and  ends  with  subtask  13  for  the  tanker  (Table  6) 
and  either  subtask  18  or  27  for  the  strike  pilot  (Table  7). 

A  summary  of  the  primary  results  of  the  44  runs  is  shown  in 
Table  14.  This  table  gives  the  total  number  of  successful  simulated 
refuelings  in  each  run  of  100  iterations.  Since,  in  each  case,  N  was 
selected  to  be  100,  the  data  reported  represent  success  percentage. 

The  data  in  each  cell  are  considered  as  representative  of  the  value  ob¬ 
tained  for  coordinates  at  the  center  of  the  cell  for  each  of  four  pairs  of 
values:  "  Fg  “  ^1  "  *^1  ’  ^2  *  “  ^2  ' 


65 


Although  the  model  provides  for  this  possible  condition,  no  attempt 
was  made  in  this  early  study  to  consider  teams  in  which  does  not  equal 


Table  14  suggests  that  the  model  indicates  substantial  differences 
in  performance  as  simulated  pilots  deviate  from  average  g  =  1).  Faster 
pilots  (F<  1)  achieved  greater  success  percentages  than  slower  pilots 
(F  >  1). 
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The  mean  over  all  11  runs  for  each  set  of  values  is  given  in 
Table  15. 


Table  15 


Mean  Success  Percentage  for  Various  F.  Values 


F. 

Mean  Success  Percentage 

First  Diffei 

0.9 

90.4 

• 

1.0 

75.  1 

15.  3 

1. 1 

50.  2 

24.  9 

1.3 

.  -  10. 7 

39.5 

The  first  difference  in  Table  15  indicates  a  15.  3  per  cent  decrease 
in  success  probability  as  a  result  of  a  10  per  cent  decrease  in  the  individu¬ 
ality  factor  (0,  9  to  1.  0).  This  effect  is  even  more  pronounced  for  slower 
operators. 

This  relationship  is  shown  in  Figure  6.  Here,  average  success 
percentages  over  the  11  sets  of  runs  arc  plotted  for  each  of  the  four  F^ 
values.  Vertical  lines  indicate  the  actual  range  of  success  probability 
values  obtained  in  the  runs. 
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NUMBER  OF  ITERATIONS 


Success  Percentage  as  a  Function  of  M 

Table  16  shows  (in  a  format  similar  to  Table  14)  deviations  from 
the  mean  for  each  run.  In  Table  16,  the  mean  of  the  four  values  within  a 
cell  is  presented  in  parentheses  below  the  cell.  This  averaging  was  per¬ 
formed  to  cancel  variations  resulting  from  the  Monte  Carlo  method.  The 
results  for  individual  runs  are  not  indicative  of  exact  task  success  prob¬ 
abilities  due  to  the  fact  that  each  value  in  Table  14  represents  only  100 
simulations,  each  of  which  is  based  on  a  random  effect.  These  averages 
indicate  the  obtained  effect  of  M  values  on  success  probability  for  the 
task  simulated.  The  expected  directional  trend  is  again  obtained.  Sim¬ 
ulated  teams  whose  members  possess  low  stress  tolerances  tend  to  achieve 
less  success.  On  the  order  of  up  to  4  per  cent  lower  success  than  the 
mean  is  obtained  in  the  upper  portion  of  Table  16,  and  similar  values  of 
higher-than-average  success  is  seen  in  the  lower  left  and  lower  right 
portions  of  the  table. 

If  one  analyzes  the  M  effects  for  the  strike  and  tanker  aircraft 
individually,  the  effect  of  the  value  (tanker)  on  the  success  probability 
is  shown  to  be  weak  (Table  17). 
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Difference  from  Average  for  Each  Run  for  Each  of  Four  F  Values  at  Various  M  and  M  Values 


3.6/3.9/-1.2/3.3  |  -0.4/1.9/2.8/-0.7 

<2.5)  (0.9) 


Table  17 


Effect  of  M.  Variations  on  Average  Success  Percentage  (All  M  Values) 

X  M 


F. 


0.9 

1.0 

1.  1 

1.3 

1.5 

90 

76 

49 

12 

3.0 

91 

76 

50 

10 

4.0 

90 

76 

52 

10 

This  finding  would  be  expected  on  the  basis  of  the  comparatively 
easy  task  role  played  by  the  pilot  of  the  tanker  aircraft,  A  somewhat 
greater  effect  of  M2  on  success  probability  is  shown  in  Figure  7.  The 
trends  Indicated  in  Figure  7  suggest  that  success  probability  is  relatively 
constant  as  Mg  increases  above  2.  0  to  2.  5.  Below  these  values  of  Mg,  a 
decrease  in  success  probability  is  observed  as  M  decreases.  This  trend 
is  also  consistent  with  that  obtained  for  the  one-man  model  (Siegel  and 
Wolf,  1950a;  1959b).  However,  in  the  one-man  model  success  probability 
dropped  by  a  factor  of  about  one -half  when  M  was  decreased  to  a  value  of 
1.5. 

It  is  conjectured,  however,  that  a  significantly  greater  drop  in 
success  probability  would  have  been  experienced  for  the  two-man  model 
in  this  task  if  additional  computer  runs  were  made  in  the  region  of  M- 
equal  to  1.  1  to  1.  3. 
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Comparison  with  Outside  Criteria 


A  primary  aim  of  this  study  was  to  evaluate  the  model  and  deter¬ 
mine  conditions  under  which  it  agrees  with  actual  events. 

Outside  criteria  data  were  presented  in  Table  10.  Table  10  in¬ 
dicated  that  10  out  of  16  actual  flight  trials,  or  62.  5  per  cent,  were  suc¬ 
cessful.  This  figure  is  shown  as  a  solid  arrow  on  the  ordinate  of  Figure  6. 

If  we  accept  the  outside  criteria  value  as  accurate.  Figure  6  indi¬ 
cates  that  the  model  produced  similar  task  success  probability  when  F,_  = 

1.  05,  or  more  accurately  when  F^g  was  in  the  range  of  about  1.  01  to  1.  08 
(as  indicated  on  the  abscissa  of  Figure  6).  These  F^g  values  represent 
operators  who  are  slightly  slower  than  the  average.  It  is  noted  that  this 
value  would  be  1,0  from  a  model  which  yielded  ideal  results.  However,  if 
one  assumes  the  universe  of  F8U-A4D  in-flight  refuelings  to  differ  from 
the  criterion  sample  obtained  by  as  little  as  one  unit  (i.  e. ,  9  or  11  success¬ 
ful  attempts  out  of  16),  then  the  model  yields  a  value  for  F^g  in  the  range 
0.98  to  1,05  for  one  unit  high  and  1.02  to  1.  11  for  one  unit  low. 

The  actual  confidence  limits  which  can  be  placed  on  the  outside  cri¬ 
teria  value  may  be  based  on  the  expression:  =-£ii£2l£l.  Even  at  the 

P  N 

one  sigma  level,  the  confidence  limits  which  may  be  placed  on  the  outside 
criteria  value  are; 

62.5%  +  i6,2»5)(37.5)  ,  62.5% +  12.1% 

—  io  — 
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This  range  is  shown  by  the  dotted  arrows  on  the  ordinate  of  Figure  6.  If 
one  assumes  the  range  of  values  afforded  by  the  one  sigma  confidence  in¬ 
terval,  the  range  conforming  to  the  criteria  data  would  be  0.  96  to 

JL  M 

1.  13.  The  F  -  values  discussed  above  (0.  98  to  1.  05)  are  well  within  this 
X  M 

range. 

A  higher  confidence  level  would  yield  a  wider  range  of  Thus, 

the  results  from  the  model  agree  with  the  outside  criteria  data  in  F^2  values 
well  within  the  limits  of  error  of  the  outside  criteria  data. 

Idle  7*ime  and  Waiting  Time 

As  would  be  expected  from  the  nature  of  the  task,  the  model  indicated 
no  idle  time  for  either  operator  because  of  the  non-occurrence  of  an  outside 
event. 

However,  during  the  simulations,  waiting  time  was  encountered  for 
both  team  members,  A  summary  of  the  average  waiting  time  (in  seconds) 
for  each  run  by  and  M2  value  is  given  in  Table  18.  The  four  values  in 
the  upper  row  of  each  cell  of  Table  18  indicate  results  for  operator  1  for 
each  F  value  investigated;  the  four  values  in  the  lower  row  indicate  results 
for  operator  2. 

Here,  again,  no  significant  effect  which  can  be  attributed  to  a  vari¬ 
ation  in  M  values  was  shown. 
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Average  Waiting  Time  (Seconds)  for  Each  Operator  for  Each  of  Four  F.  Values 


The  average  waiting  time  for  all  runs  over  all  M  values  is  shown 


in  Table  19. 


Table  19 


Average  Waiting  Time  for  Various  F.  Values 

3 


F. 

3 


0.9 

1.0 

1. 1 

1.3 

Tanker 

2.3 

2.6 

2.9 

3.5 

Strike 

13.0 

14.3 

15.5 

18.3 

Table  19  suggests  that  the  effects  of  F.  are  approximately  linear 

3 

on  waiting  time  for  this  task.  As  one  might  expect,  faster  operating 
teams,  F^  :  Fg  =  0.9,  are  required  to  spend  less  time  waiting  for  each 
other.  Quantitatively,  the  model  indicated  the  tanker  to  spend  about  0.  3 
seconds  more  and  the  strike  pilot  to  spend  about  1.  3  seconds  more  in 
waiting  for  every  10%  decrease  from  "average"  in  team  speed. 

Time  Remaining  After  Task  Completion 

An  important  use  of  the  model  could  be  to  provide  quantitative 
predictions  on  how  much  time  remains  to  the  operator  after  his  task  is 
completed.  No  field  data  were  available  against  which  to  check  these 
computed  results  for  reasonable  correspondence  with  reality.  Although 
these  data  may  have  limited  value  in  the  validation  of  the  model,  they 
would  be  important  when  investigating  or  comparing  proposed  man- ma¬ 
chine  systems. 
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Since  T  =  41.  6  seconds  nnd  T.^  -  70.  0  seconds,  the  strike  pilot 
was  the  pacing  team  member,  and  the  average  time  remaining  for  the 
tanker  pilot  is  of  no  consequence  in  this  task.  The  average  time  remain¬ 
ing  after  completion  of  the  simulated  task  is  shown  in  Table  20.  The  data 
in  the  upper  portion  of  each  cell  represent  the  average  time  remaining  after 
task  completion  considering  only  successful  task  simulations.  The  bottom 
row  of  each  cell  in  Table  20  indicates  average  time  remaining  after  all  simu¬ 
lations. 

These  data  indicate  little  overloading  for  the  average  (F  =  1.0)  and 
slightly  faster  than  average  (F  =  0.  9)  pilot.  However,  according  to  the  mod¬ 
el,  for  the  somev/hat  slower  than  average  pilot  (F  =  1.1,  F  =  1.3)  the  time 
allowed  for  this  task  is  tight  and  overloading  present. 

A  plot  of  the  average  time  remaining  after  successful  simulations 
by  F^  value  is  presented  as  Figure  8. 
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Figure  8  Average  time  remaining  after  successful  task  simulations 
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TerminEii  and  Peak  Stress 


Tables  21  and  22  present  respectively  the  average  peak  stress 

conditions  and  the  stress  conditions  at  the  end  of  the  selected  computer 

runs.  Data  for  the  tanker  are  presented  in  the  upper  row  of  each  cell 

and  for  the  strike  pilot  in  the  lower  row  for  each  of  the  four  F.  values. 

3 

As  expected,  both  the  peak  and  the  terminal  stress  values  increased  with 


increasing  F 


j 


values;  this  indicates  that  slower  operators  may  be  expected 


to  build  up  greater  stress  than  faster  ones.  This  finding  also  reflects  the 


fact  that  slower  operators  complete  less  work  in  a  given  time  and  conse¬ 
quently  their  T,  -  tH  values  (on  which  stress  depends)  are  lower.  It  is 
3  ^3 

further  noted  that  over  all  M.  conditions,  and  in  conformity  with  expec- 

3 

tation,  the  strike  pilot  built  up  greater  stress  than  did  the  tanker  pilot. 
Review  of  the  individual  run  data  indicated  that  the  peak  stress  condition 


occurred  near  the  end  of  the  runs,  e.  g. ,  when  the  strike  pilot  closed  in 
for  actual  probe  insertion. 


Average  Peak  Stress 


Skipping  of  Non-Essential  Subtasks 

The  model  calls  for  either  operator  to  skip  each  non-essential 
subtask  whencveirhis  stress  exceeds  imity.  Table  23  presents  a  sum¬ 
mary  of  the  number  of  non-essential  subtasks  ignored  by  each  simulated 
operator.  Although  reported  in  the  final  computer  tab\ilations.  Table  23 
does  not  indicate  which  subtasks  were  ignored.  The  upper  row  of  each 
cell  applies  to  the  tanker;  the  lower  to  the  strike  pilot.  These  data  which 
are  directly  dependent  on  stress  data  are  strongly  influenced  by  the  stress 
threshold.  As  an  example,  the  results  for  the  second  operator  over  all 
M  values  are  presented  as  Figure  9. 

Figure  9  suggests,  in  disharmony  with  expectation,  that  operators 
with  lower  stress  tolerances  skipped  fewer  non-essential  subtasks. 

In  conformity  with  expectation.  Figure  9  also  suggests  that  slower 
operators  skipped  more  non-essential  subtasks. 
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rigure 


(Mj) 
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Average  Terminal  Cohesiveness 


The  cohesiveness  index,  as  included,  must  be  inversely  inter¬ 
preted.  A  high  number  indicates  low  cohesiveness:  a  low  number  indi¬ 
cates  high  cohesiveness. 

The  data  on  the  mean  cohesiveness  of  the  operators  at  the  end  of 
the  simulations  are  presented  in  Table  24.  The  tanker  pilot's  cohesive¬ 
ness  of  zero  or  near  zero  merely  indicates  that  either  his  stress  at  the 
early  completion  of  his  own  work  is  zero  or  that  the  stress  of  the  strike 
pilot  at  that  early  time  in  his  task  is  zero.  The  data  for  the  strike  pilot. 
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Average  Terminal  Cohesiveness 


0.9/1.0/1.1/1.3 


o  0> 


CHAPTER  VI 


SUMMARY  AND  CONCLUSIONS 

The  development  and  application  of  a  model  to  simulate  system 
operation  by  a  two- man  team  is  described.  The  model  is  based  on  psy¬ 
chological  dat^  and  concepts  applied  through  digital  simulation  techniques. 
The  purpose  of  this  model  is  to  answer  questions,  while  a  system  is  in  the 
early  design  phase,  such  as  the  following: 


1.  Given  a  selected  machine  design,  can  an  average 
two-man  team  be  expected  to  complete  success¬ 
fully  all  actions  required  for  task  performance 
within  the  time  limits  given  for  each  operator? 

2.  How  does  task  or  system  success  probability 
change  for  slower  or  faster  teams  and  longer 
or  shorter  periods  of  allotted  time? 

3.  How  great  a  relative  stress  is  placed  on  each 
operator  during  his  performance  and  in  which 
portions  of  the  task  are  the  operators  overloaded 
or  underloaded? 

4.  What  is  the  frequency  distribution  of  each  opera¬ 
tor's  failures  as  a  function  of  various  relative 
stress  tolerances  and  team  member  speeds? 

5.  For  how  much  time  is  each  operator  idle  while 
waiting  either  for  the  other  operator  or  for  some 
outside  event  to  occur? 


The  model  is  based  on  the  high-speed,  general  purpose  digital 
computer.  Tne  computer  operates  on  source  data  concerning  subtask 
performance  by  average  operators  and  on  system  parameters;  using 
these,  it  simulates  each  operator  by  calculating  values  for  and  keeping 
track  of  items  such  as  his  performance  time,  task  and  subtask  success 
or  failure,  stress,  idle  time,  and  cohesiveness  with  the  other  operator. 

A  buddy  system  in-flight  refueling  operation  was  simtilated.  This 
consists  of  13  subtasks  for  the  pilot  of  the  tanker  aircraft  and  27  subtasks 
for  the  pilot  of  the  receiver  aircraft.  A  total  of  4,  400  simulations  was 
performed,  representing  44  combinations  of  pilot  types. 

Empirical  comparison  of  the  predictions  from  the  model  with  out¬ 
side  criteria  data  on  in-flight  refueling  success  indicated  reasonable  con¬ 
cordance. 

For  the  task  simulated,  the  model  was  found  to  act  rationally  in  that: 
[1]  it  showed  a  greater  success  percentage  for  faster  teams  and  for  teams 
with  greater  stress  tolerances,  [2]  it  showed  greater  idle  time  fc"  faster 
teams  and  slower  teams  to  be  more  overloaded  during  task  performance, 

[3]  it  showed  greater  stress  to  be  exerted  on  slower  teams,  [4]  it  showed 
slower  teams  to  demonstrate  less  cohesiveness,  and  [5]  it  showed  slower 
operators  to  skip  more  non-essential  subtasks. 

It  may  be  concluded  that  in  this  initial  validatory  study  the  model  yielded 
results  which  largely  appear  to  conform  with  logic  and  with  empirical  data 
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Additional  validatory  studies,  over  similar  and  other  classes  of  tasks, 
are  required  for  greater  confidence  in  the  generality  of  the  model. 
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APPENDIX  A 


Appendix  A  briefly  summarizes  the  major  similarities  and  dif- 
derences  between  the  two-operator  model  here  described  and  the  uni¬ 
operator  model  previously  developed. 
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The  two- man  model  is  similar  to  the  single  operator  model  in 


that: 


^•1.  task  success  is  based  upon  the  time  taken  by 
the  simulated  operators  to  complete  the  task 

2.  a  Monte  Carlo  technique  is  employed  in  the 
calculation  of  subtask  execution  times  for  each 
operator 

3.  consideration  of  operators  of  various  speed 
capabilities  is  included 

4.  operators  with  various  stress  thresholds  are 
considered 

5.  urgency  and  operator  stress  conditions  are  cal¬ 
culated  prior  to  the  performance  of  each  subtask 
by  the  operators 

6.  the  operators'  failure  to  perform  subtasks  prop¬ 
erly  affects  their  stress  level 

7.  capability  to  simulate  idle  time  for  either  oper¬ 
ator  is  included 

8.  simulation  of  decisions  made  by  either  operator 
is  included  to  determine  the  course  of  action 

9.  simulation  and  computation  is  performed  by  a 
high-speed  digital  computer 

10.  results  are  obtained  from  computer  recordings 
of  task  success  probability,  time  remaining  after 
completion,  idle  time,  stress  conditions,  and  sub¬ 
task  failures 
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I' 


rhe  two- man  model 


■'erf:!  fro’i-  in':'  one-operator  model  in  that 


tv/f  ■•■Kdr.  mr'?  :1  v,ontains  :  following  in.proved  features; 

«  -V 

It 

...  capability  :^simula.te  either  operator  waiting 

2.  improved  rr.  1-  ^thod  for  computing  normal  deviates 

from  pseud.;  ^  -landom  numbers  i.-i  the  interval 
0  to  1 

3.  capability  to  l.’lsimulate  communication  between 

operators  ^ 

4.  capability  to  ^j>alculate  a  team  cohesiveness  in¬ 
dicator 

5.  capability  to  1;:  -nuiate  decisions  made  by  either 

operator  V' 

6.  recording  of  tional  data  for  analysis  'e.  g. , 

peak  stress  valu4-..,f!‘.^  identity  of  non- essential 
subtasks  ignored the  operator,  etc.  ) 

7.  automatic  prepart of  ^ore  extensive  sum¬ 


maries  of  results 
mations  as  well  as 
tions  and  subtaakn) 


V  the  computer  (run  sum- 


1 


results  of  individual  simul?.' 


8.  dependence  of  ope-a  performance  on  the  Istre 
value  of  his  partner 


1..  addition  to  these  improved  -^.^tures,  the  technique  of  preparii^g 
compute.  Instructions  is  improved  by  f  automatic  programmi.-..; 

methods  and  a  higher  speed  computer  .s  9  vilized. 
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